I witness almost daily people that are either in government or even friends of ours who say we have to win the AI war with China. And I don't know what that means. I can't imagine an end state where we control all the AI and they don't have any. It's already too late. It's too late. And they're smart. And the reality is that we just need to focus on running our fastest race. We need the Teslas. We need...
open AIs. We need rockets that land themselves. We need all of this. But to think that they're not going to have BYD building great cars, or they're not going to have DeepSeek building great models, or they're not going to have rocket companies that copy us and can land themselves. I was like, that would be naive. It's remarkably naive.
Bill, it's good to be with you. Good to see you. I mean, we're in this, should we tell him that Steve Ballmer gave us this man cave? It's a private cave in the intro. I mean, the truth of the matter is... The hardest thing about this pod, I love this pod, but you and I getting our schedules to match and actually getting together. And so I've gotten a ton of feedback. I've seen on Twitter people like, when are you guys going to record the pod first? Thank you for the audience.
encouraging us to do this because I love doing it. Know that we would love to do it more. It's just a little challenging to get together and to do it. We have an ongoing dialogue, I think pretty much 24 by 7, about this stuff going on in the world. And then occasionally we get to get together and share it with you all. So, I don't know, I thought maybe today... Today, Bill, we'd kick it off with Grok 3. So we're now like 10 days out since Elon and his team unveiled in pretty record time.
An unbelievable model. And so maybe you can just help us. zero base where you thought, what you thought when the model came out, where it stands, you know, it kind of in the rankings. Then we can have a conversation about kind of the impact and what it means. you know we've talked about this in the past but but everyone in the ecosystem was super impressed with how quickly they built the memphis facility exactly and how big it was and it's the largest you know
contiguous cluster in the world. And there was a lot of chatter about that ahead of time. And I can remember some of the investors there saying, this will prove that pre-training still has headroom because this will be the biggest. cluster ever trained on. Correct. And you can decide what your expectation was after that kind of line in the sand.
Things that happened, I mean, I think the generic way of saying it is like it went right up near the top of all the benchmarks. Right. Ahead on some, not on others. Some people argued about. The reasoning component, the beta reason. Or did they cheat or overtune to a benchmark? But I don't think it matters. I think the biggest positive takeaway is there's a new player.
in the model market and we had often a lot of people said this is a sport of kings there's only going to be so many players correct there's a new one in the market invested what they needed to do that has access to capital right has a data asset that that they argue is important and special and was able to get.
at the front of the race let's just call it that right right and you're looking at you know we're looking at this artificial analysis that just shows i mean there's this clustering here in the upper right you know deep seat kind of got up there a couple weeks before you had grok
You know, what's interesting is they all seem to be coalescing in an impressive way around the top of these benchmarks. When we say they all, I mean, we're really only talking about five or six players who have a chance to be in this game at this point.
Correct. And I saw people who interpreted Grok's fast rise as proof that pre-trainings... still got legs and to me i kind of had the opposite reaction which is i felt like they just slammed up against this the ceiling that's holding everyone in right although although again an incredibly capable Oh, no doubt. I've said this for a while. I've been concerned that the way an LLM works and the way it's optimized, that building bigger clusters and more parameters won't buy you much.
Whether I've said it or not, Ilya said it, Andreessen said it, other people have said the same thing. And so to me, this reinforced that point. I was expecting... If there were pre-training headroom, I was expecting this to go through. Now, I will qualify.
this was their first run right maybe there were some tricks they didn't know right they could very well back up and do another run on that same large cluster and maybe shoot past these people or maybe these benchmarks aren't the exact right thing to be looking at right to say a couple other things. Number one, it's not just a pre-trained model. They also have an inference time reasoning component to the model that's incredibly capable.
We have this benchmark chart, right, that I tweeted the other day and I compared it to kind of the search index benchmarks that we all used to track. And, you know, the benchmarks are one thing, but the reality is it's... How do we feel when we're using the product? And what I will say is Grok3 rocketed to the top of all app downloads on the iPhone charts. At least my Twitter thread.
was full of people having great experiences, showing those great experiences on Grok 3. So it had a personality and an interaction with people that I think people were enjoying. Number one, it just has to be capable enough, right? And it clearly crossed the threshold of being capable enough. Now the real question shifts to, can they leverage the X platform, right? Which reaches...
a massive and important audience to really drive that. And what I would say, the early indications to me, when you compare it, for example, to how Meta has used Meta AI, like... As incredible as I think Zuckerberg and Meta are and the advancements they've made, I have not...
particularly been impressed by the productization of meta AI, right? It's basically just a search box stuck at the top of Instagram or stuck in my WhatsApp thread. And when I'm on it, I never intend to be there. It's not the right context. Whereas on X, they... figured out, you know, the first thing they did is they put that button at the bottom of the app.
clearly distinguishes it as its own standalone application. They launched a standalone application. They're using X to drive those app downloads. And now I just opened up my X app today and it said, hey. go out and try the new voice for Grok 3. To me, the execution on the product side to drive consumer use has been pretty damn impressive and took them to the top of the charts. Yeah, and only DeepSeek and Grok.
of all the others have shown the ability to break into the top 10 on the app store download. Exactly. And so I think that while we all have a fascination where, where did they get to on the benchmarks? My own sense at this point in time is...
You know, this is going to be one of these battles, kind of like Search was at this point in time, where you know the five or six players. And it's going to be, you know, just out today, literally, as we're about ready to go on, you know, OpenAI has released chat. ChatGPT 4.5. And they've kind of hinted in, I guess, this presentation as to ChatGPT 5 or 6, I guess, that was shown on a screen. And if you look at 4.5, one of the important distinguishing elements that they're pitching...
is it's more human-like it gives better answers more concise answers etc not a big breakthrough on the evals although there are some improvements in the early looks against the evals But I think ultimately we're going to measure the success of these things by how many people are using it.
I think one thing to be good for the audience, I know you've said it in the past, but you're an investor in OpenAI, and I think you have a theory about their prowess in the consumer market and their lead in the consumer market. So why don't you reiterate that?
Yeah, well, I mean, you know, I've showed this chart before, right? That in the search wars, we had Google and Yahoo and AltaVista and Lycos and Ashcheeves and Excite and Infoseek. And by the way, they all did pretty damn good on the benchmarks. But the reality is that didn't get them to any value creation because ultimately all the consumers aggregated around Google. So the real question is, does that same pattern play out?
of winner take most in consumer around AI, right? It did in search and it did in social. But it's not necessarily, you know, follow on that it will in AI because, you know, I'll stipulate X has an incredible installed base. that they can market into. Meta has an incredible install base. Google has it. And it's existential for those companies in order to market to those consumers. So I don't think it's going to be win or take as much.
I don't think we're going to see a 99 percent monopoly here, but I do expect that, you know, we're going to see 70 or 80 percent share go to the winner. Now, if we look at the numbers. Yeah, the numbers. Yeah, if we look at the numbers today, I think last week, Sarah reported. that OpenAI has crossed 400 million weekly average users.
And that's a user number, not a paid user. That's a user number, right? The number of paid users is a fraction of that. I think they also reported last week something like $11 or $12 billion in expected revenue this year. You know, you can reverse engineer your way into kind of what percentage are paying for that. But more importantly, I think the number of monthly average users must be somewhere on the order of magnitude of seven to 800 million.
monthly average users, and you and I followed consumer for a long time, there's this magic number around a billion. I mean, I already think they're near escape velocity, but at a billion monthlies, you can funnel all of those. into weeklies and then you funnel the weeklies into paying subscribers or people who are consuming advertising. So what I have seen is everybody else catch up on the benchmarks. What I have not seen is people catch up.
on the consumer velocity. Let's handicap some of the other players a bit. Who do you think is closest from a user standpoint? Is it probably, you'd have to count the Gemini searches in the Google search, right? To get to a number that's close to opening. Yeah, I mean, listen, I think, you know, let's just start with Google, okay?
So there's been a lot of reports out over the course of the last couple of weeks. We have public companies now reporting that are reporting their Google organic clicks are down 20 to 40% year to date. So the question is why? Like, why is Google's clicks down so much? Because if I do a Google search today on my phone, half of the page is taken up with an AI answer to whatever my Google query is, and the rest are all paid links, right?
I think Google, I think that's the right decision for them to make, right? If you want to compete, you ultimately have to be willing to, you know, take the innovator's dilemma head on and really just cannibalize your product with AI. Now, if they do that- And if you're one of these humans- Thanks. SEO wasn't dead already, which I would have declared it dead a while ago. It's really f***ing dead. SEO is dead. Those are the free links that was the core product that used to attract...
everybody to Google. And the idea that SEO is basically now gone is pretty extreme. You know, I think, and this is just an aside, but I've been remarkably frustrated with Google's organic links for the past. five years because you go in and search for your favorite team schedule right and all the ticket guys are up front now like the link you're looking for you have to hunt well okay so let's talk about that for a second i mean now
The obscure link or the obscure information that you and I may be looking for may be on page three, four or five. You and I are never going to get to page three, four or five. What's so interesting, for example, about OpenAI's deep research. Now, if I launch a query using deep research, it will go to page four or five or 10 or 100 and find those obscure pieces of information. So I think the evolution of Google actually provides.
acceleration to the deep research projects because I don't want to go do that deep research. So Google... I think you just can't discount their installed base. The number of people going there who will, inertia will continue to carry them there. But I would say this, and you can go search for this on Twitter or anywhere else.
And I know certainly with my own behavior, the amount of activity that I used to do on Google has been 80% cannibalized by ChatGPT because there's search embedded within ChatGPT. And so, you know, I'm getting all of that. information, all of those answers. So I think that they're going to be formidable. I think they're being bolder than they've been.
But I think they'll have to continue to do that. I think that we've talked about this, but I think some of their assets are remarkable. I mean, you got the YouTube data set and all the search queries over all the years, their understanding of. structure of structured data around a lot of the consumer verticals I mean they built that out in airlines and things that should be able to do those agent type
queries better, faster, should. Their velocity on product has not been impressive. Their velocity on consumer has not been impressive. So they have them. They've had them for a long time, Bill. They had ChatGPT before ChatGPT. Android, which is a massive asset. And they also have browser. They're their own browser, which both Perplexity and OpenAI have started.
toying with the idea of either having a browser or in the operator case of using a browser in the cloud to go do this work. Anyway, they have so much. I still think they have a bit of the innovators dilemma in that. They still have to try and maintain those paid links on that page. And this chart here, the black line, is Google's paid click growth.
plotted against the user, the weekly average user growth at OpenAI, it's not going in the right direction. Well, and I think it benefits from the fact that informational searches are what... check gpt cannibalize first not the commerce searches which is where most of the money is on the paid right although you know again and i we're going to see this out of x we're going to see it out of everybody right
Everything, the entire domain of the internet is the domain of agents. So if you think about operator. As one of the first agents rolled out by OpenAI, what does operator do? It goes and it mimics me as a human going out and researching a hotel and booking a hotel or whatever on the internet. And we're in a very embryonic state. I agree with you. We're not.
there yet. But it's very clear what the roadmap is going to be. It's going to want your credentials. And whether you give it your credentials or not is going to matter because it's searching against an unlogger. So let's talk about meta. Actually, one last thing on Google.
There was a point where Meta went public at 40. Backed up the truck. We had some, so I was paying attention. And Zuck, as he has many times, got... woken up on mobile 100 and everyone thought he was dead because and he had also built an html5 he didn't believe in native app there's a whole thing that they weren't going to be able to monetize mobile he was on it was on the cover of Barron's Magazine. Yeah. The Weeknd Magazine, right? It was like Facebook's dead. Right.
But he woke up and fixed it. Can Google do that here? Is that possible? Can they have a similar, like, and what would it look like? And what would it take? Well, I mean, listen, I've said publicly that... Google's moat was not a technological moat with search. Their moat was a distribution moat. Their moat was a mindshare moat. We Googled everything when we wanted to know anything. And the only thing that could attack Google was never anything head-on. It had to be an orthogonal attack from...
something that was 10x better, 100x better, because it gave us answers instead of blue links, right? That's why it was such a mortal sin for them to ever, ever. allow anybody else to go first because the only thing that could give you a trillion dollars worth of free mind share is going first with something that was 100x better and that's exactly what chat gpt did in 20 at the end of 2020 all right go to go to go to meta So, I mean, you know, again, meta, if you had to handicap the big guys.
3 billion users of their product. I think they have products that are tailor-made for chat-oriented AI, whether it's Instagram and having shopping agents and, you know, co-shopping agents or whether it's WhatsApp. and just having a bunch of agents live within my WhatsApp channel, it feels natively much better positioned for AI. And we know that Zuckerberg is in complete beast mode.
But I am surprised, I have to say, that we're now kind of 18 months into kind of the llama thing and it feels like the manifestation of it into the product. was slower than I expected in 2024. Back to your product point. Right. Exactly, right? Like, Meta hasn't... And I will say, I will say even, you know, we know he was rip shit about Deep Seek, right? kind of blindsiding Lama in the release of R1.
And so I would say it's not just product for them. I think they have, you know, I heard from several inference players that you and I are friends with that all of a sudden deep seek rather than llama is the enterprise open.
model of choice that everybody's experimenting with and playing with. And so that becomes a real problem for them as well. So I think 2025 is a critical year. I think they will come through. And remember, When it comes to almost all product stuff, stories, copy, you know, catching up with Snapchat or whether it's reels catching up with TikTok, they've always showed up to the party late.
But they are grinders and they always deliver the product. It'll be interesting to see what they do. Who else would be in the list? I mean, Anthropic has really not been. No, they pretty much seeded the game on consumer. You know, there was a product announcement yesterday. about they're going to be powering Alexa. But now we're stretching, right? And Amazon did do a big Alexa.
launched yesterday. Correct. Pretty late in this game. Yeah, and by the way, Alexa is not really in, again, it occupies a different space in most consumers' minds. It is not what ChatGPT does. And so I think... to dislodge something that has the momentum chat GPT does, you have to go at them and do better than what they do at the thing that they do. And this is why I think X. You know, if I go through the whole list here, X to me is so interesting because they have.
a platform that is the number one news platform in every country on the planet. The people who are most actively engaged are using this platform and they go there for information, right? They go there for answers. They go there to engage. I think it's an audience that's very well suited for AI.
I think the integration they've done is as good. By the way, they've done this in a very short period of time. And I mean, I'm talking everything from the logo. Some of the tweets will have the logo pop up and then it'll summarize. or do more research. So I'm really, really impressed at the velocity of not only catching up on the benchmark.
but catching up on the consumer product side. And so, you know, listen, they're number one on the app store and that stands for something, you know, coming out of nowhere. And people said that Elon couldn't, you know, couldn't do this. I never doubted. They would catch up on the benchmarks.
if they got a big enough cluster. Because Elon set a mission that people become messianic about, you know, and his engineering capability to build out the cluster and do all those things. So that was never the question for me. The real question was, can anybody... Can he close the gap on the consumer race? Yeah. OK. And there, I think, you know, the odds on favorite there.
It has to be OpenAI. I think they continue to widen their gap, by the way, Bill. I think they're accelerating at scale, but that's where the race is. And it may very well be that coming in second place with 20% share is a pretty good place. to be I want to mention one more company and then I I'm going to make a guess at four ways someone could try and win this game. But the one I want to mention before I do that is just perplexity real briefly. I will give them credit for being.
product-centric, to your point, and innovative in ways that the others haven't. and kind of on their own terms. They don't have near the usage of OpenAI. So there's a question. It kind of looks like an acquisition candidate to me. I don't know if anyone can agree on price. But for one of these other players that...
hasn't been as successful from a product standpoint. I mean, you could, you and I just had this conversation. I mean, you could imagine, for example, a world in which Microsoft were to buy perplexity and now they have a consumer brand to go battle it out. We know how much Satya wants to win in consumer.
Now, he owns a bunch of open AI, and so he's got some potential channel conflict there. But I think the bigger issue at this point now, we know with Leanacon out, you're probably more likely to be able to do a deal like that. But-
When founders are raising at $8, $9 billion, it becomes a much, much more difficult decision for a company like Microsoft. Not saying that it couldn't happen, and I will say this, that when it comes to... you know, punching up, being innovative, being scrappy, product velocity. The founder there, Arvind, and the team, it's been super impressive to watch. I think they've made other people better. But the numbers, I think, as we look at them today,
You know, they're really powerful, but much smaller player. So here we go. Here we go. I have four things I'm watching out for that could potentially lead to either further lock in by OpenAI or a window for someone to do something. out. As some of them I mentioned before, but I think, you know, memory is still this thing that could... just tie you to something and um open ai has probably done more with memory than anyone else but no one's really got to the place where i'm
telling it to remember things, to store things, to create lists, like where it starts to become like an executive assistant for you. And I haven't seen that yet. I still think that's a... dimension that could really be important voice we've talked about and they're all playing with it I think voice and also ties in with device type and this is where Alexa may have some you know some
But like, you know, if the voice were spectacular, they might not have to carry the phone around as much. And by the way, by the way, I need it. Yeah, you need an earbud. You need an earbud. I will say. Advanced voice mode on ChatGPT is excellent. Grok3's new voice, excellent.
And they're getting better at an accelerating rate. You know, we're an investor in this company, LiveKit, that's powering a lot of this voice. And I will tell you what I see in the product pipeline is super impressive as to what's coming with voice. The third one's nebulous, but just someone could focus on a feature that no one has to date. And right now, the game looks so much like with the benchmarks and voice, everyone's running.
same place so i don't that's an easy thing to say but it'd have to be really out of the box and and then fourth i just have been thinking about this um no one's really thought about a network effect yeah and i wonder you know how you could make the quality of the ai experience a function of your user base like let me give you an example of a network effect i think that is happening okay i think around model improvement
If you have 700 or 800 million monthly average users, your diversity of information and questions and answers and follow-ons, et cetera, is much, much higher. Those questions and data, that's now being fed back into the models to improve the model. Some users may have seen, I know I have. You get two answers and the OpenAI asks you to. Right, right. So I think that's an example of OpenAI very actively.
building, attempting to build network effects in terms of the quality of the model, the quality of the answers. But there could be a more intense form of network effect if you found a way to. to leverage the user base as part of the value property. Let me go back to your first one, memory, because you and I have talked about this a lot, right? If you get memory, the switching costs explode. Exactly. Right? And I would argue not only does switching costs explode.
The conversion rate from free to paid probably also goes up, right? Just because the value delivered. I think you're right. And so I was with my 89-year-old mother last Sunday. And my mom has wanted to write a story of her life for a long time. And the reality is she's never going to sit down and write the story of her life. And yet when I'm with her, podcast style.
I'll ask her questions and I'll just record it on my phone, right? So that I have it and I could perhaps go back later. And then I started thinking about it and I said, I don't need to be the interviewer.
right advanced voice mode could be the interviewer and so i was sitting there with her last weekend here's the prompt you know that i gave to advanced voice mode i said you know i'm sitting with my 89 year old mother tonight who wants to write her life story I want you to interview her about her life, to ask questions about her childhood stories.
having kids, working, growing up in the depression, her love of computers and travel, to remember everything you talk about and then compose a story of her life that her grandchildren would like to read, okay? And then advanced voice mode just started asking her questions. How long did it go on? I mean, my mom was really nervous at the start, but then like a little tear wells in my mom's eye, you know, because she realizes all of a sudden.
Oh my God, this could be a massive unlock. So here's the thing, Bill. Advanced voice mode in ChatGPT already has memory. You can already do these things. The problem is the nature of the product. You don't know that it can do those things. So part of the challenge about... designing a product where prompt is your way in is you've got to help people imagine. Like you and I could have imagined in the age of internet, somebody building an internet website that just did that thing.
OK, so I think that's one of the challenges all these companies faces and the innovation around that top end of the funnel in the prompt that can help people better get into it. I'll give you another example. Deep reasoning. which is really fascinating. They basically took the O3 series of models and fine-tuned it end-to-end based upon all these browser interactions.
But the more specific the prompt, the better the deep research report is going to be. So a lot of people are using O1 to help them build sophisticated prompts that they then feed in. to deep reasoning. And so I think that there's something in there where we're effectively using AI to get us to the point where we're better prompting. And one of the ways will be very simple.
Right. Once I have this assistant, I'm having an interaction. I just say to my assistant, hey, my mom wants to tell her life story. I'm not sure how to go about doing that. Do you have any ideas? And she would say, hey, yeah, just use this prompt. No doubt. And I also think. that there are other assets that could play a role, like a contact database, an email. Yes. I mean, I can even imagine moving my email to one that's...
integrated inside just because. Contacts is a great one. If they just cleaned up your contacts. Well, knowing my contacts. Right, and knowing your contacts. Yeah, but send an email, send a text. I mean, there's a lot. And then for anyone that works with content, there's some app. All my writing and everything I've done for the past 10 years.
years it's been equipped but some people use notion yes and like like that type of repository and how these things can interact there's just a lot of surface area to figure out like where does that story land where is it stored right once you did it exactly or do you have to take it out of open ai like you know you'd rather
just have a place. Correct. And now you have projects in OpenAI and other things. So this is, it brings me to a point. When you think about these research labs and you look at the number of people who work there, right? Just the fact we even call them research labs, you and I haven't, you know, nobody called Google a research lab, right? It was a company.
They have product teams, they have marketing teams, they have finance teams, etc. But I think because a lot of these people came out of research, that you look at them and they're still very small teams, very heavily tilted toward building toward the benchmark. OpenAI now has thousands of people. I know, you know, Kevin Weil, who runs the product team over there. You look, so...
All these companies, if you're going to win this race, you got to do all the things, great things that great product teams do. And it's building all the shit that you're talking about. And that's hard. And you got to be thoughtful and you got to growth hack and you got to, you know, get those customers to use the product more and more.
One thing came out this week, which I don't know if it was intentional or not. You may know more than me. Someone published the internal forecast of OpenAI, which included, I think...
In 25 and 26, losing 20 billion each year. And someone said to me, why would they publish that? Why would, you know, lose that? And to me, I think there's a... information war out there trying to scare capital in or out and to lay a statement that if you want to be in this game and keep in mind there's a variable cost every time you serve a deep research
And so if this is one of these situations where people think it's winner take all, just like we had with Uber Lyft, and they're going to go hard at trying to win.
you probably need to be willing to lose $20 billion a year to step into this game. And X looks like they have the potential to raise that kind of money. I don't know if a Microsoft... or an amazon are prepared to lose incrementally that amount of money well this is i mean this is just such a fascinating segue into by the way there's one company we didn't even mention yeah like when we went through all this we didn't mention apple
Right. Like at all. Pretty shocking. Right. Pretty shocking. Why didn't we mention? Well, I mean, so Apple has self-selected out of the race, right? They're not building a big model. They've been very public about they think that they can be kind of late mover here. They did this Apple intelligence integration with ChatGPT and now they're going to do a Gemini. And the reality is.
You know, as I shared with an Apple executive the other day, I said, here's the only integration that matters, my ChatGPT app on the front page of my Apple phone. Wow, that's mean. Well, I mean, it's the truth. I just don't use any of the integrated features on the phone, which I think creates vulnerabilities for Apple. But I think, listen, this is the first time that they've been faced, I think, with this level of product. risk. But the reality is
They have such lock-in on this device. For somebody else to build a device, maybe Huawei around the world, they're going to be able to ship perhaps better AI phones around the world. They're not going to be able to ship them into the United States. We'll see what this Google ruling... is at the end of the year, if Google is no longer allowed to be the default search app because of this consent decree, you know, do they...
really turn Android into the thing that it potentially could be. So I think there's a bunch of potential risks. So we didn't talk about Apple. I'd say the other company we didn't really talk about because we're so focused on the United States is when you look outside the United States, you really have to look. to China, because I would say the acceleration and velocity of AI in China is off the charts.
We've talked a lot over the last few weeks about DeepSea clearly coming out of left field, very efficiently building a frontier quality open source model. But most people have kind of quietly ignored probably the company that's the leader in AI in China, and that's ByteDance. Their AI, you know, their Chad GPT equivalent is number one in China.
And they've been using AI to drive TikTok globally for a very long period of time. So I know you have strong opinions on this. It seems to me the U.S. has underestimated. China at AI. And now we're at this inflection point where I think there are a lot of people who say, well, they must be smuggling GPUs into China or this or that. But the reality is-
China is going to have frontier AI and almost all of the things we do to try to slow them down and stop them are backfiring on the United States. I couldn't agree more. I witnessed. almost daily, people that are either in government or even friends of ours who say we have to win the AI war with China. And I don't know what that means. I can't imagine an end state where we control all the AI and they don't have any. It's already too late. It's too late. And they're smart. Possibly can be.
And they're innovating. And you look at all the other products that they're crushing it in. Yeah, I just don't understand. And the reality is that we just need to focus on running our fastest race. We need the Teslas. We need the open AIs. rockets that land themselves. We need all of this.
But to think that they're not going to have BYD building great cars or they're not going to have, you know, DeepSeek building great models or they're not going to have rocket companies that copy us and can land themselves like that, that would be naive. It's remarkably naive. And it's going to lead to people making decisions, like you said, that either slow us down ourselves. A lot of the AI regulation would definitely do that.
Or just provoke them in ways that isn't helpful. And it's not going to slow them down. Well, let me give you one example of this. And then I want to move on talking about the arms race, if you will. You know, during the Biden administration, they passed something called a diffusion rule out of the Commerce Department, which we've mentioned on this pod before, which created this convoluted set of rules by which U.S. semiconductor company...
companies could export outside the United States. Now, this wasn't exporting to China. We already have export restrictions with respect to China, but it basically made all these tiers and classifications on how much you could distribute. Did you have to distribute it through a high- hyperscaler or not and the whole idea was to somehow prevent these chips from getting to China but what it really does is it
causes us to have to compete globally with Huawei with one hand tied behind our back. And it almost guarantees a Huawei level belt and road initiative around the world. And the world's going to run on Huawei AI chips, which gives them that. the demand that they need to build a frontier AI chip. And so again, well-intentioned perhaps by the Biden administration, but-
totally backfires. And hopefully Howard Lutnick and this administration will throw that out. I think there are a remarkable amount of people in Washington on both sides of the aisle that have a... perspective about China that they use words enemy threat have to win the AI war and I just those terms are so loaded. But I think they think they can achieve something. And if I owned NVIDIA, my number one concern would be excessive regulation coming out of Washington. My number one concern.
Let's shift gears here for a second. You talked about OpenAI losing this report that they were losing $20 billion a year. One thing I would just say, I'm not going to share anything that I shouldn't share. However, I think one always has to keep in mind what is operating expense and what is capital expense, right? And there's a variable cost of serving a chat GPT query. Right. And, you know, I would posit that those variable expenses are not very high like at maturity. Although a deep.
Like a 01 Pro search or deep research could cost 20, 40, 50x the other. Correct, correct. But I would just posit for you that you'll be able to come up with a variable expense structure using the right. mix of models that will be a great margin. May not be as high as retrieval was for Google, but still a great margin. I think what people are conflating, Bill, is when you decide to spend $20 billion a year to build out Stargate, to build out
to do all these things. Now, as you know, a component of that is the CapEx needed to serve the inference and a component of that is CapEx to build future products, right? And so, for example, if we're looking at... Facebook or we're looking at Google or we're looking at Microsoft. Microsoft, I think, is spending 80% of their free cash flow, right, on CapEx.
We don't quote that as their profitability. They have their net income, and then they have their net income less capex. I would keep that in mind. But what I would say is. These folks are very committed to continue to invest aggressively in a future that they see as big. But we heard from Satya on the Dworkish podcast, right? what many are characterizing as a pushback against these high levels of spending. I think of my fleet even as a ratio of the AI accelerated storage to compute.
And at scale, you've got to grow it. And so that infrastructure need for the world is just going to be... exponentially growing, right? So in fact, it's mana from heaven to have
these AI workloads, because guess what? They're more hungry for more compute, right? Not just for training, but we now know for test time. And as I said, test time, like here's an interesting thing. When you think of an AI agent, it turns out the AI agents is going to exponentially increase compute usage because you now are not even bound by just one human invoking a program.
but one human invoking programs that invoke lots more programs. And so that's going to create massive, massive demand and scale for compute infrastructure. So our hyperscale business, Azure business, I think that's like another hyperscalers, I think that's a...
And I think on the pod, he reiterated, we're going to spend $80 billion this year. We'll spend more next year. But there's not a world in which we're just going to have unlimited, unconstrained spending. Now, this week, we also saw rumored that Meta is out shopping for... For a campus, a data center campus, the rumored amount is $200 billion, capable of building six to eight gigawatts.
Now, that sounds a lot like Stargate, which is kind of in that 6 to 8 gigawatts. Microsoft, I think, has 5 gigs installed, probably is going to build a... For what? What? Five gig worldwide. Is that what you mean? Correct. And going to build more. So again, it seems to me that if you want to be in the group of five or six.
That's kind of the calling card you have to have. You have to either have a business or the ability to raise capital such that you can deploy a sufficient amount to build out that level of compute. Now, in the case of OpenAI, Ma enter masa? back to Lyft Uber. And, you know, Masa is rumored to be leading, you know, a very big round, $40 billion round, you know, with a lot, which we saw they announced it at the White House. It is important. Many people interpreted.
Satya's comments is a tapping of the brakes. Yes. So tell me how you interpret it. And he said, because he said, I'm happy that some of these are leases. Yes. Which... I don't know any other way to interpret that. Well, there's two ways you can interpret it. One is he's telling you, like, I'm hedged against this being overbuilt. Yes. Or I'm better off canceling a lease than...
sitting on infrastructure. I would say it even a little bit more. Like, let's be honest. Satya said last June, we talked about on this pod, that it was very likely that at some point there would be a supply and a demand mismatch and you had to build a resilient company that could go through a zone of disillusionment, right? So he basically said the reckoning is coming at some point in time.
And so now he goes on Dworkish. He kind of sounds like he's tapping the brakes a little bit, you know, and so I think that... the interpretations of that should not be that he doesn't believe in AI. I think he very much believes in AI, but he's running a public company. And I think that he's made commitments to his shareholders. And he's saying, listen, I need to see a certain amount of inference revenue.
in real time to justify that level of CapEx. Look, I mean, I think everyone believes in AI. This amount of spend is something we've never seen before. That's why I've said... you know, that it's like better than watching Secession. This is true. It's a massive sport of kings. And I think some of the things, whether it's the 20 billion losses or Satya saying he's glad he's got leases, some of these might be part of an information.
you know, war with other players trying to talk capital in or out. For sure. And it's a high stakes game. It's fun to watch. Well, I think resiliency. Business mono resiliency is going to be critical here. And what do I mean by that? It means liquidity. Because we know in the internet, there was a zone of disillusionment.
We know in social there was a zone of disillusionment. We know in cloud there was a zone of disillusionment, right? A period, what do I mean by that? A period where the prices and the spend got ahead of the revenue, right? You know, given the level of competition some people describe as a prisoner's dilemma, right? In the case of Google and Meta, they literally have a printing press in the back room spitting out billion-dollar bills, right? So they are resilient.
Microsoft, resilient. In the case of OpenAI, they have to raise money. So you need to have a big stack behind you. In the case of X, they need to be able to raise capital. I think there were some numbers out there last week. Obviously, Elon is the wealthiest person on the planet. He can sell shares and some things. But I think the most powerful thing Elon has.
is a global belief in him as an entrepreneur, which gives him an opportunity to raise capital from sovereigns around the world. And so if you said, is this still an open sport? I'd say no way. Right. I don't know anybody else other than the Elon and Sam at this point. Deep Seek surprised everybody. Well, I'm saying if you're going to play that game. Yeah. Right. And remind you, Deep Seek spent.
more than, you know, the amount reported in their last training run. But even more importantly, to serve an explosive amount of inference, they would have to spend a lot of money to build that. I want to make a point that we'll probably come back to much later.
But when you have a scenario that has this much ambition and this much competition and this much... capex as part of the game yeah it's easy to lose sight of the microeconomics it's easy to lose sight of the unit economics so if you're a you know an anthropic and you've you've got training credits over here and you've got capex and you you do you're not like am i thinking about depreciation or that when i say oh this is profitable or when i price my ap
product and you've got this razor edge pricing thing yes that is I've never seen before yeah explain what you mean by that I mean the the price difference between today's model yes and yesterday Jay's model is 20x. Yes. So it's a fast depreciating asset the second you're off the frontier. Yes. Yes. And so it's just, it's a dangerous, like these are all traps. Yeah. You know.
And it makes it, you know, once again, fascinating. Maybe we can transition to the public markets a bit, but there's a lot of talk that we're going to see a core weave filing. And I'm just excited to see the numbers and to piece together more. Yeah, there's a rumor out there that the CoreWeave is going to file an IPO, and so you can see the numbers. Well, I just want to underscore this point that you just made, though, because, I mean, and there is some rhyming.
Tommaso coming back into the scene here, right? Masa is one of the greats of this industry of the last 25 years. But I think people would also describe him as somebody who's a bit of a gambler and places gigantic bets. And some people would say that he's a total visionary and other people would say he's just not price discriminating. But clearly he's shoving all in.
I don't think he has any other way of operating. Right. And so I think the point being that we're at this moment in time where… The danger for the company, I just want to underscore what you said, the danger for the company of getting this volume of capital is that it's hard to focus. on really building the muscle and the grit and the ingenuity on how to drive unit economics. Think about what Elon had to do at Tesla.
right? Because capital was hard to come by. So he had to figure out how to make money on every damn car. How do I take costs out of the manufacturing at every single stage of production? And when you have excess capital. Right. You lose that discipline. You don't build that muscle. And so I think it's an important.
admonition for the board and leadership at OpenAI and all these companies to hear that, sure, it's one thing to invest aggressively in the future, but you better make sure that along the way your unit economics work. No doubt. I know you've been thinking a lot.
lot. Let's switch gears. You've been thinking a lot about Doge and if it happens, what it means for the capital markets. And it's interesting to even say if it happens, because as I watch the press every day, there's an equal number of people that... say, oh, this is going to take out all these costs. And there's other people that say, oh, they're just saying things, but they're not actually going to happen. You and I said some, you know, so I think on our pod on like February 6th or something.
You know, when you asked me about the markets, I said, hey, we have peak political uncertainty, right? Because we have a lot of things changing. We have peak economic uncertainty. And that's not just dose because that brings tariffs. Right, because we have tariffs and other things. And I said that we have peak technology uncertainty.
uncertainty i.e. it's hard to predict the future you know what software company is going to be worth what in five years and that causes discount rates to go up it causes multiples to come down and i said i was surprised how resilient the market it was in the face of all this uncertainty. Well, now I would argue we're starting to see a few cracks in that. And so if you look at this chart, Bill, it's really the NASDAQ.
since the election. And we ran way up. The NASDAQ was up as high as 10% post-election. And now we've come off four or five points from that high. But we're still four or five points. higher than we were on the night of the election. And so one thing I just have been thinking a lot about and I've been talking a lot about is this difference between stimulus and austerity, okay?
Over the last three or four years, we had massive stimulus into the economy. Now, you and I both supported it in March and April of 2020, right when we were in the depths of COVID. You had to prevent the economy from coming to a screeching halt. And so the Fed went all in and Congress went all in in order to save the economy. But then we also were very critical that the Fed moved way too slow.
The second stimulus package was way too large, and it led to this runaway inflation. We saw inflation hit 9%. But the one thing that all of that monetary liquidity did to the system is it caused risk assets. to go up in value, right? And now we're in this period where we're talking about not adding a trillion and a half of liquidity to the system. We're talking about pulling a trillion and a half out. Now, what do I mean by that? Okay, so.
Last year, we had $56 billion of tariffs imposed on other countries. That's the amount of revenue we collected from tariffs. We're talking about that going to $500 billion. So 10x in the amount of tariffs. We know that some of those will be eaten by producers, right? The company that's producing something in China will just...
take a lower margin. But we know a lot of those will be felt by U.S. consumers who just end up paying higher prices for their Dell computer because Dell passes along the price increase of the computer made in Mexico, as an example. So that's $500 billion. On the other hand, I think Doge, there's no doubt in my mind at this point in time, and we'll show this chart of the likely spending cuts.
They're not only making big cuts, and the president has now just last week said he wants Elon to be more aggressive, right? They sent this email out to every employee that said, you know, respond back to us or you'll be deemed. to have resigned. Now they're giving them more shots on goal. But the message is very clear that I think there's going to be a downsizing of the federal government to the tune of, let's call it 40 or 50%.
A lot of people have been giving a lot of grief to doge, but I remind you, and I tweeted this the other day, that Bill Clinton, right, did doge in the late 90s. Yeah. I don't know the exact percentage of federal employees they let go. It was like between 10 and 20%. But we had a balanced budget. You know, in three fiscal years, we had a $230 billion surplus. It was helped by the internet, but now we're going to be helped by AI. So like, I think that you can see
some replay of that, but it does mean that we're probably gonna take 500 billion to a trillion dollars out of federal spending over the course of the next couple of years. And all I'm suggesting is that austerity... has the reversed impact of liquidity from government into the system. So if you think about, go back to our GDP calculation, right, in macroeconomics, C plus I plus G.
where G is the amount of money the government's spending. Well, the amount of money the government's spending is going down. So tariffs is a headwind to the economy and this austerity out of the government. I am 100% in agreement. This is the short-term shock therapy we need in order to get our fiscal house in order.
Right. But you got to think about this as, you know, somebody says, hey, you're out of shape. You're going to have a heart attack. You got to, you know, you got to take this medicine, this short term pain. You got to work out every day. You got to get fit. Right. In order to avoid the heart attack, you would do it every day of the week. We need to get fit in order to avoid bankruptcy. And all I'm suggesting is it might affect markets.
that it might affect markets. So markets may in fact, right, my risk profile is lower than our standard risk profile. What do I mean by that? Very simply, you know, I own half as much as I would normally own at a point. in time now do i think that's because the future uh you know is bleak no i believe aggressively in the future but i think we're gonna have to take a little bit of short-term pain which means we could see just a random run of the mill 10 to 50
15% drawdown, right, in the markets while the market gets its head around the fact that the economy's gonna grow a little slower. When the economy grows a little slower, that means companies grow a little bit slower. When they grow slower, you know, the earnings go. down and the multiple goes down. Let me ask you this question. When Elon went into Twitter, one of the stories that came out was that they found there were software licenses for a whole bunch of people that they weren't using.
That they cut that dramatically. Do you anticipate that one of the outcomes of Doge will be a... You know, obviously a headwind for a bunch of companies that have sold software and or services. 100%. I mean, like there's just no way around it. You know, if you go from 3 million federal employees to a million and a half federal employees, then you don't need as many licenses. You don't have as much cloud consumption, right? And so if you think about the multiplier.
You take the federal government or federal person's salary, employee's salary. Now you have all the health care and benefits and pension and all the other stuff. And then you have all the ancillary spend. So I won't say the exact company, but I talked to an airline the other day. And at this airline, their number of government tickets sold year-to-date is down 50%. Already impacted. 5-0%. Yeah, because they said...
We don't want you traveling. We want you in the office every day and all this other stuff. And so this airline has already been impacted. So I think everybody in the ecosystem, if you have revenue line items, if you're a business, if you're a public company, you have revenue line items.
items from the federal government. It's not just that the rate of growth is going to slow. It's that they're actually going to be negative on a year on year basis. Now, again, I happen to think this is a generally a good. sacrifice for us to make. Those are our tax dollars. There is no government money. This is our money that's being consumed. But I don't think the public markets or investors generally, and certainly not Silicon Valley, has kind of gotten their head around.
this means. In fact, I would say, ironically, this happens quite a bit in our world, but Silicon Valley and the venture capitalists have just gotten comfortable with With backing companies that sell to government. Exactly. We see a lot of that. It's an interesting timing. People get excited about it. Well, you saw what happened to Palantir stock the other day when, you know, the president directed. his cabinet member, Secretary of Defense, to find 8% cuts in the Department of Defense every year.
Right. And so this austerity again is real. Now, that probably means we're going to have a rotation of money out of like the less technologically innovative folks into the more technologically innovative folks. But, you know. He went further. Trump went further. He suggested in one thing, which I was really blown away by this. I actually thought it was kind of the most interesting thing he's done. He suggested to Xi that China... America should both cut their military budgets in half.
Yes. Now, maybe that's provocative. Maybe it's hard. That'd be an amazing idea. I thought that was extraordinary. Back to the, you know, this idea, you know, we've been... We both blow up the world many times over, so... Right. There's a certain camp of folks, right?
And I think Mearsheimer is in this camp, right, which is great power politics. And like, you just got to build, build and build. And, you know, eventually you're going to have a war or something like this. Or maybe the fact that you have these stockpiles deters, you know, the. ultimate war. One thing that is just fascinating, I've never heard an American president in my lifetime suggest that he wanted to sit down at a table with China and Russia.
and talk about they could collectively cut their military spending in half. And just from an entrepreneur perspective, it caused me to stop in my tracks and be like, That's an interesting idea. I thought it was the coolest thing he thought of. That's an interesting idea. Well, I will tell you back on the public markets, the other interesting thing here, Warren Buffett.
Just put out his annual letter. He's going to have his annual meeting coming up here. Has a $400 billion cash stockpile. Has been liquidating stocks. His biggest stockpile in ages. Stan Druckenmiller. Howard Marks, Stevie Cohen came out over the weekend and said, I'm nervous about the markets for the same reason that we were talking about a month ago. So I think there is a growing chorus of players.
What's the flip side to this? Well, since Trump's been elected, the cost of a mortgage or credit card or et cetera is starting to come down. Why is that, right? There are two reasons. The first reason I think is because We're saying, okay, the economy is going to slow a little bit. And if the economy slows equities as an investment.
are a little less positive relative to a bond. So you rotate that into cash, and when the cash is sitting on the sideline, it's invested in a U.S. Treasury. Just to put it in perspective. And the only anecdote I really ever hear about this is, well, China doesn't want to own our treasuries anymore. China buys 3% of our treasuries annually. It's tiny. They used to buy, you know, 10 years ago, they bought 12% of our treasuries and everybody panicked that they were too big a buyer.
What I see is just the opposite. Every sovereign around the world and every domestic investor who's starting to put more money into cash, who's hedging a little bit, all of that's going into US treasuries. So I just think that- One should brace over the next three months. I think these tariffs are very real. They're structural. And the president is committed to them. I think number two, the reconciliation package is now rolling. And I think they are very committed.
to balancing the budget within this president's term. And the only way you balance the budget is a trillion dollars has to come out of spending. Remember, 2019 baseline, we were spending about five trillion. The COVID high, $7 trillion. We got to get that back down to at least $6 trillion, probably to $5.75 if you're going to balance the budget. That means a trillion out in a year, that's austerity, and that's going to be a headwind to the economy, but it's the right thing to do. Okay, that's a-
Tough note to end on, so I'll switch to something more positive. I got invited to the Golden State Warrior game on Tuesday night. The Butler trade looks like it's working. It's incredible. Six and one, I think, since the trade. It's incredible. I was related. I happened to go get an invite. to the banner ceremony and dinner afterward for good friend Andre Iguodala. And Steph gave an incredible speech.
And I had Andre speak at our investor day maybe two years ago. And two things Steph said, you know, that really stood out to me. you know, about Andre. Number one, he said, there is no this without Andre, right? And by this, and he explained it to me, he said, he came at a moment in time. Even his decision to come to the warriors made us believe in ourselves. And then he came here and he did whatever it took. And the second thing he said.
is Andre Iguodala always put excellence over ego. The guy would be the first to, you know, never pound it on the bench. When he came off the floor, he was the first to get guys fired up. And Steph talked about game six in Boston. I remember that game. I was at that game. And I remember Andre. He must have played five minutes in that game.
And he was so fired up and really willed all the players to up their game. And so I was so happy for him. But yes, and you know, me and our good friend, Jason Chang, I never bet on sports. I never bet on sports. And he talks me in. We're at a Warriors game during the losing streak, and the odds are so great that they're not going to win at all. He talks me into, you know, placing a bet on them winning it all. And at the time, it was like 40 to 1, right?
them. And all of a sudden they're on the six game winning street. They trade for, you know, for Jimmy Butler and like they may win this whole thing. So, you know. Fingers crossed. It now has me with a focused mind. It's great to see you. Great to see you. Take care. As a reminder to everybody, just our opinions, not investment advice.