The Vergecast RAM Holiday Spec-Tacular - podcast episode cover

The Vergecast RAM Holiday Spec-Tacular

Dec 23, 20251 hr 27 min
--:--
--:--
Download Metacast podcast app
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Summary

This Vergecast Holiday Spectacular unravels the mysteries of Random Access Memory (RAM), detailing its fundamental function, historical evolution, and modern ubiquity. The hosts and special guest Dylan Patel from SemiAnalysis explain why RAM has become a precious commodity due to insatiable demand from AI data centers, the concentrated nature of its manufacturing, and the industry's conservative capacity expansion. The episode also includes fun RAM-themed games and speculates on future market dynamics and potential technological breakthroughs.

Episode description

The world runs on RAM, and RAM is harder than ever to get your hands on. What’s happening here? Every year, the Vergecast team spends the holiday season going deep on a single spec or technology, and this year it’s all about Random Access Memory. (No, that’s not a Daft Punk album.) Nilay, David, and Sean Hollister explain what RAM is, why it matters, how it became a precious commodity, and what it means for the future of chips around the world. We also play some games. We do… okay at the games. Happy Holidays!


Subscribe to The Verge for unlimited access to theverge.com, subscriber-exclusive newsletters, and our ad-free podcast feed.We love hearing from you! Email your questions and thoughts to vergecast@theverge.com or call us at 866-VERGE11.

Learn more about your ad choices. Visit podcastchoices.com/adchoices

Transcript

Ads and Show Introduction

Does it ever feel like you're a marketing professional just speaking into the void? But with LinkedIn ads, you can know you're reaching the right decision makers. A network of 130 million of them, in fact. You can even target buyers by job title, industry, company, seniority, skills, and...

Did I say job title? See how you can avoid the void and reach the right buyers with LinkedIn ads. Spend $250 on your first campaign and get a free $250 credit for the next one. Get started at linkedin.com slash campaign. Terms and conditions apply. So good, so good, so good. Give big, save big with Rack Friday Deals at Nordstrom Rack.

For a limited time, take an extra 40% off Red Tag clearance for everyone on your list. All sales final and restrictions apply. So bring your gift list and your wish list to your nearest Nordstrom Rack today. Toast the holidays in a new way and raise a glass of Rumchata, a delicious creamy blend of horchata with rum. Enjoy it over ice or in your coffee. Rumchata, your holiday cocktails just got sweeter. Tap or click the banner for more.

Drink responsibly. Caribbean rum with real dairy cream, natural and artificial flavors. Alcohol 13.75% by volume, 27.5 proof. Copyright 2025 Agave Loco Brands, Milwaukee, Wisconsin. All rights reserved.

The Holiday Spectacular Tradition

Welcome to the Vergecast, the flagship podcast of the Daft Punk album, Random Access Memories, and the Reddit thread I just found asking, what would be the name of the tracks on Daft Punk's Christmas album? which I encourage everyone to go spend a lot of time reading. I'm your friend, David Pierce. Nilay Patel is here. Nilay, hello. Hello. Sean Hollister, also here. Hello, Sean. I am also a friend.

Is the Vergecast holiday spectacular? Which I would say, Nilay, is it fair to say this is just a joke that we made one time that has now gotten way away from us over time? Yes, to the point where I'm wearing a holiday muff. Okay. I'm glad you brought this up. What is that? So I was going to wear a Santa hat, but I couldn't find it. The last time I wore the Santa hat was last year on this show. So I don't know where it is. It should just be in this room. But last year, I...

acquired from my wife what can only be described as a holiday muff, which I'm currently wearing. It's a scarf, but it's a loop. It's very warm. How many stars does it have? It's a lot. I look great. What I've come to learn is that I should be a scarf guy. You should. I actually agree with that. I look terrible in scarves, but you're kind of pulling this one off. I feel great about it. My neck is very warm because I would like everyone, if you're listening to this, imagine.

Like the, if you've ever seen a dog wearing the cone of shame, but it's not a cone, it's just the sort of inflatable donut they put around their necks. That's Neelai, but make it fashion. You know what I mean? Yeah. No, Becky's very fashionable. This looks great on her. I don't agree that it looks great on me, but I'm pulling it off right now, I want to say. Sean, you meanwhile managed to make this space that you're in go from not...

holiday-y at all to extremely holiday-y in like three minutes, which I'm very impressed by. It turns out that my wife is quite the Christmas decorator and every other part of this house had lots of stuff to steal. So I stole all of it. That's great. So your room is the respite from joy and happiness and seasonal feelings, except for right now. Unless those feelings are Star Fox. I love this.

I do want to say I was going to put some holiday art from the Samsung Frame Store on the Frame TV behind me, but I was worried about copyright infringement. So this is just a winter scene painted by Van Gogh, who is dead and can't sue us. That's right, Ben, go. It's a challenge. What up, Vince? Yeah. Toe to toe, Vinny. So what we do every year on The Spectacular is we pick...

Choosing RAM as This Year's Spec

a spec or a technology or some piece of this world of tech that we live in and get like weirdly deep into it. And we've done. Neil, help me remember, we've done Bluetooth in the past. We've done USB-C in the past. We did Matter last year. That was very fun. What else? We started with HDMI because the joke was that after the first Trump administration, we had so much politics on the show. We were going to clear the air. We were going to reset.

with a full hour on HDMI to do the nerdiest possible thing that was in politics. And now we have to do a spectacular every year. A beloved, beloved thing that we all very much enjoy doing. By the way, it's time to do HDMI again. I think we're... We're headed towards needing to do another HDMI episode. We're not going straight to 6G? So, okay, Sean, I'm glad you brought this up. Here is a partial list of things that we could have done instead of the one that we've picked. We could have done 6G.

It would have been a very short episode and it would have made all of us very angry, but that's an episode we could have done. We thought about doing, instead of doing Matter last year, we almost did. ARM, just the idea of ARM chips, which I think was very important last year, continues to be very important. All things LLMs, you could spend a lot of time just digging into inference as a spec, which would just get real weird with it. That's not a spec.

We could do TPUs. You want to do TPUs for an hour and a half? These aren't specs. It's a spectacular, not an acronym spectacular. I am very down for less letting the LLMs play for us. It's true. We could do Wi-Fi 7. That's a spec. We could do satellite internet. Not a spec. I'm sure there is a spec. I didn't...

do enough research to care, but you know, there's, there's specs involved. There you go. Li-fi. Um, I thought about doing the wireless power thing where you can like point a charger at yourself and apparently won't. That's what Sean's talking about. I proposed E-Ink Kaleido. Travis shot that down fairly quickly. Travis suggested Labubu, which may or may not be a spec. We can debate that later. But the one that we decided...

What Is RAM? Fundamentals and History

is RAM. We're going to spend this whole episode talking about RAM. At least RAM contains within it specs. RAM, what is everything if not a bundle of specs? You know what I mean, Eli? Think about that. We are all specs. Yeah. But RAM, I think, Sean, my question to you is, would you have gone into 2025 expecting to spend as much time as you have covering specific sticks of RAM?

Absolutely not. This stuff is commodity. It's so boring until it gets fascinating and you find out how it's made. But just take it for granted, right? It's everywhere. You don't need to think about it, I thought. Yeah, I feel like it's like a thing we write about sort of as a clause in a sentence in a phone review about how much RAM it has. And that is most of the way that I've thought about RAM.

For my entire adult life. And now all of a sudden it is like a precious rare earth mineral in the world. And we're going to talk about why. So we're going to do this show in three parts. First, we're going to we're going to just. build up some knowledge of RAM. Sean, you are going to just school us on what RAM is and how it works and how it became to be a thing that we all care deeply about. Then Travis, our producer.

has some games that he has created slash vibe coded that are, I assume, going to make us all look very dumb and be deeply terrifying. And then we're going to have a conversation at the end about kind of the macroeconomic chip war of all of this. There is a big picture. question about how chips get made and who's in charge and what it means for the future of technology and we're going to get into all of that but that is for later and for now sean we asked you to like

really give us the like kindergarten starting education and how RAM works. Are you ready for this? Oh, boy. Can't wait. All right. So let's let's literally start from nothing. What what is RAM? And where did it come from? At its very, very basic, there are now, nowadays, chips that are going to be on a stick or possibly... patterns etched into the top of your processor that also do this memory thing. And their job is to store charge. They will store a little bit of electricity.

That indicates if it is a one or they will not have that amount of electricity and not have quite that much charge in it, it will be a zero. And these ones and zeros represent computer memory because it is it is code. This is the the digital, you know. 01 that you hear about, this is where it is stored temporarily inside your computer, inside your phone, so that the rest of the computer can read it and say, what did I just compute?

Now I can act on that previous thing I computed and do more with it. And so computers didn't always have this chip kind of memory. They had all kinds of other kinds of memory before this. There were switches you would have to flip or rods or gears that would be turned to a certain position in a mechanical computer that would be, this is my storage, my memory of what I just did a moment ago so that I can do more computing on top of that.

Modern RAM: Speed and Proximity to CPU

But all of these forms were known as memory, and the RAM, the random access of that memory, is the thing that the computer is doing all the time, randomly looking at... various parts of it to find out what it's stored temporarily in its memory that it can look back at. The kind of RAM we talk about most of the time is DRAM, dynamic.

random access memory. This is called dynamic because the charges that are stored in it need to constantly be refreshed. The memory doesn't have any, it doesn't remember what's inside of it when it doesn't have power it needs to constantly have power so that's refreshing those things but we have other kinds of memory we talk about is storage we have ssds which keep stuff in there longer without power not forever but longer

Most of the time right now, though, and the crunch that we're talking right now is mostly about DRAM. Memory that's going to give you that little short term for the computer to act on it again. I feel like it's important to say here that historically...

DRAM has been much faster than the other kinds of storage on a computer, right? So back in the day, the hard drive was really slow, quite linear, actually, in how it stored information. And you would want to have a lot of RAM because it was so much faster to get.

information in and out but that's sort of equalized right like modern ssds and ram they're closer than they were but they're still not very close right yeah memory is much much faster than storage still but but storage is We're at the point now where in most computers, you'll have your...

your your random access memory that's that's doing the very quick you know calculations back and forth between the processor and computer companies want to keep that memory as close to the cpu the actual instruction parts of your computer as possible so they're baking it under the board They're creating special rings of logic where something can pop out of the CPU and into memory and back into a CPU thread so quickly that...

They're getting even more performance out of it than they would if they had it on a separate stick further away from the CPU. So they prefer that higher bandwidth, that faster access if they can. But yes, the solid state drives now, they're quick enough that you could have a cache. on there. Some people will talk about doing, back in the day, you could speed up your whole computer by using your

DRAM is like a temporary storage for your programs. You'd like just throw your game in there or something like that. So you could load it even faster than storage. Storage is fast enough now we don't think about that much anymore. Okay, so RAM...

Evolution of Memory Technologies

Actually, I did, I would say, like, four minutes of research. And it turns out RAM has been around much longer than I realized. Like, the way I've always thought of RAM is basically, like, you have a hard drive that is sort of spinning.

and trying to find things in a linear fashion in a row. And actually storage doesn't quite work that way. So everything is all over the place. So your drive has to constantly spin around and look for stuff. And that takes a while. And RAM just can look for it all at the same time. And that is much faster. This is basically like a thing that I learned listening to music on knockoff iPods in the early 2000s. That's the extent of my RAM education.

But this is a technology that's been around since like the middle of the 20th century, right? Like who, where, where did this actually come from in the first place? I don't remember who quite did it first, but when you're looking at early computing, people will talk about the Babbage engine. And they would have like rods that would be in a certain position. And that would tell you, you know, it would store the previous calculation. And then some of the early computers would have punch cards.

or tape that would have punches through it, and you would read that. There would be various switches that you would flip or gears turned to a certain position. At one point, they had vacuum tubes where you've got this idea that... a vacuum tube when it's on can store a little bit of energy in there.

Not to interrupt you, but every single one of those things sounds so cool and futuristic. Yeah. I'm like, that sounds sick. Let's do that. That's probably better. And then it's like, no, these were all the bad ideas we had before. Vacuum tubes are great. Everybody loves explosive decompression and tremendous. amounts of energy required to do anything, right?

At one point, they had CRTs where you would store the bits on the screen of the CRT as a charge. You've got your electron gun firing your charges at the screen. That creates your phosphorescent image that you see on a CRT TV. why not store the memory there too? And then there was ring memory, the core ring memory at some point where you'd have wires kind of all wrapped.

in patterns. And inside of each of those places, you could store the charge for longer than you could in some of the previous technologies. You can store many of them in a lattice. And I've gone to the Computer History Museum in Mountain View, and you can see hand-woven memory.

As this, as this thing, it looks like a bunch of cords knotted together. It's fascinating stuff. I still would bring all of that back. I'm looking at my desk now being like, my computer needs like several more vacuum tubes and something very cool will be happening.

But as far as I can tell, RAM is one of those things that it's like there are a bunch of things in sort of the history of computing where a thing was created and everybody kind of looked at it and went like, oh, yeah, this is better. And it just immediately.

took off and won forever and i feel like we're in year like 60 of ram which suggests that everybody just decided this was the right idea the thing to know now i think is that they are computer chips the RAM bits on your memory stick that goes in your computer. It is created basically the same way. It is the same material. And so when we're talking about the shortages that we're seeing now, these shortages may intersect with other places because what you're doing fundamentally is...

you've got a silicone wafer you're taking a single big crystal of silicone you are cutting it using like a diamond wire or a diamond you know edged rotary saw into incredibly thin layers like quarter of an inch thick and these are being patterned with chemicals and ultraviolet light and then etched with acid or plasma into these little chips. And it's the same process used for processors, for computer processors.

also used for memory the same kinds of wafers we're talking about about 13 inches wide are used for computer chips they're used for memory chips and so we've we've digitized all this and made this much more efficient and small but now it's kind of the same thing

So the gap between all of these different things has actually like shrunk a lot over time. So when we talk about like storage and processors and RAM, like the distinction, it seems like matters a lot less than it used to. I had never really thought about that until just now, but it does.

RAM as a Ubiquitous Commodity

It is all becoming sort of a single system in the way that it was not. Like, I still think of RAM as like a giant stick of thing that I shove into my desktop computer. And that is, in almost every case, not what RAM is anymore. Well, it's also not where the volume is. Right? Like phones, there are more phones than laptops. Right? There are more phones than cloud servers. And RAM isn't all the phones. It's soldered into the phones. Those aren't sticks. You have a lot of feelings about that.

Maybe we should all put dimsticks into our phones. That'd be kind of cool. But, you know, if you listen to the Apple earnings call or Dell's earnings call, all the analysts are always talking about fluctuations in DRAM pricing. Because there's only so many vendors of RAM, which I'm sure we'll get into. They are kind of a commodity. It moves up and down like oil. And if the price of RAM is high, Apple's margins are lower because they, you know.

the price of the iPhone does not fluctuate with the price of RAM. So this is in the background of all these businesses is, oh, RAM is a commodity and the price moves up and down in a way that, Sean, I don't think like the price of... m4 chips moves up and down right in the same way that ram is a commodity and the price moves up and down yeah now if you want if you want intel or apple or you're like a samsung

If you want TSMC to create you a chip, you talk about like, do they have the capacity at their fabs to make as many chips as you want? And if they do, you pay, you know, this much. And if they don't, you try to pay more. So you bump somebody else off of the fab. or get the capacity that's coming later in the year, whatever it is. With DRAB, there are so many wafers that are going to these three, basically three companies that are creating this stuff, and they're...

You know, they don't want to create too much of it, but they know generally how many PCs and how many phones are going to be sold in a given year. And they just produce a lot of it and everybody buys it off them. Yeah, Ram is one of those things. It is like so deeply unsexy, but it is.

increasingly everywhere. And I feel like we've been on this march and we talk about this a lot on this show, that everything has become a computer, that my dishwasher has a computer chip that probably resembles a smartphone chip. in it. And so does basically every other piece of electronics in our world. Has RAM

scaled the same way? Can you sort of spin around in your chair and probably find 100 things with RAM inside at the moment? I can tell you this frame TV doesn't have enough RAM in it. I can tell you that right now. Yeah, I can also tell you that. Having just watched you go through the interface to select this photo. Something I didn't know until we were doing this report the other day is that the solid state drives have RAM in them too. I figured you didn't need...

Very much of that. But, you know, there's some cash in there. There's some cash in there for the solid state drive, so it can run faster. RAM is now, it's just utterly ubiquitous that way, right? It's just the same marches sort of as smartphones became this gigantic.

massive industry, smartphone chips went everywhere. And RAM has done the same thing. To the point where it is baked into many of those chips. Sure, yeah. Your phone doesn't necessarily have... an application processor soldered here and a ram soldered there it has the ram packaged into the processor in many cases that's what i call them socs right that's you know

The chip people, the chip fluencers get very mad when you call them CPUs. They're SOCs. They're systems on a chip. And part of that system is... the memory is the RAM. So I bet your dishwasher actually has an SOC. By the way, I've been watching you through your dishwasher for weeks now. You're loading it all wrong. My wife would tell you that's absolutely correct. But your dishwasher probably has an embedded

SoC that is a complete system containing RAM that is, you know, whoever just bought off the shelf and shoved in there. Yeah. So, okay. So Sean, tell us about 2025. What the hell happened this year that I have to think about RAM in my day-to-day life now?

The 2025 RAM Shortage Causes

I don't know exactly how it began, but I don't remember anybody forecasting that all of a sudden AI data centers would be buying up so much of the world's RAM that the rest of us would be scrounging for leftovers. Do remember them saying that DDR4, an outgoing standard,

Would be a little bit pricier because they were trying to end of life. It's like, OK, yeah, there's less of that to go around. So if you got an older computer, you might pay a little more to get your older RAM. Double data rate for synchronous dynamic random access memory. DDR4 SD RAM. Good Lord. Okay, so they're trying to phase out DDR4, presumably to phase in DDR5.

They're trying. Yeah. And we got we got DDR5. It's everywhere. If you're buying a new computer, you're going to buy that instead of DDR4. You stick it in your graphics cards. So you stick a graphics version of it in there. There's even six for graphics cards and seven. But moving on from that.

Yes, the general standard DDR5. And it goes in all the computers and it goes in the kind of computer you'd buy for yourself. And it goes in the laptop where you don't even think about it. And it also goes in the AI data center. The AI data centers want as much of it as they can possibly get, just like they want as many GPUs as they can possibly get. Can I actually ask about that? So I heard there's a data center RAM crunch, and I thought...

Oh, it's because NVIDIA is selling a lot of GPUs. Today, Senators, don't the GPUs use a different RAM? Don't they use VRAM? They have their video RAM. It's on a slightly different standard, but fundamentally... All the memory is coming from just a few companies who have a limited supply of wafers that they are cutting out of ingots of silicon and doing their chemical treatment processes on.

Everybody who's making these computer chips is going to be fighting for some of that supply. And the RAM makers in particular control, these three companies control 93% of the world's supply of RAM. Who are those three companies? This is Micron, SK Hynix, and Samsung. Oh, sure. The first three companies I think of when I think of tech companies. SK Hynix runs the world. You shut your mouth when you talk about SK Hynix. SK Hynix is the biggest of the three. Okay.

And Samsung also, these three companies, 93% of the other companies that there are, there is only one other company that has even 5%. The rest have 1% or below. Wow. Okay. And so... if you want ram you're going to one of these three of these three one of them just said we're done with consumer business we're just going to focus on enterprise now we're going to focus on data centers because that's where the money is and of the other two

Samsung and SK Hynix, they may have contributed as much as 40% of the world's entire supply of memory to a single project at OpenAI going on right now to create a massive set of AI infrastructure there. Wow. So just to be clear, it's not the AI data centers need more regular RAM for the CPUs or more VRAM for the GPUs. It's just RAM in general is needed for these build-outs.

It's all of it. I mean, if you're building your computer inside this data center, it's going to need a GPU, and that GPU is going to have memory. It's going to need a CPU with normal memory to talk to. And so it'll have some normal memory in it. It's going to need SSDs, which can have a bit of memory on those. It's going to need...

All kinds of networking, fancy networking switches for their, for their infinite link or whatever. There's memory inside those. All of these things are consuming memory. And. So much of it is going there now that companies are saying, if this is the way things are going, we don't need to worry about consumers so much. We're going to have plenty of money from where the profits lie.

And we saw this already happen to some degree in GPUs. I mean, we saw AMD say, we're not going to make a high-end graphics card for gamers this year because we want to put our resources toward AI GPUs instead. We saw NVIDIA not say that, but then kind of do that anyway, although they do have plenty of consumer GPUs. It's been harder to get them. They've been pricier. They know that they can charge gamers more.

Because if gamers don't buy as much, that's not a problem for them. They're making $30,000 off of one of the AI GPUs. They don't need to make $1,000 off of a gamer.

Real-World Impact of RAM Scarcity

So if I'm one of these three companies, basically, I've looked at the market and I'm saying, OK, I can sell to like Dell who wants to make some laptops and I can sell to like nothing who wants to make some smartphones or I can sell. Essentially to like the five richest companies on earth who are all trying to build AI data centers and want to buy from me in unbelievable volume. And like.

Any reasonable shareholder value maximizing company is going to pick the thing where OpenAI just writes you the largest check you've ever seen in your life. Antonio ran into Dell's COO the other day. And got a whole long, mostly empty spiel about how Dell has all these relationships with these suppliers, and they go back years, and it kind of boiled down to...

Dell may need to kind of tap the companies on the shoulder and be like, remember me? Please give me some memory. We have these deals and we would like them to be fulfilled. He said that supply... Getting supply is their focus this year. They haven't already negotiated the supply, apparently not to the degree that they need. So how wild has this gotten? You saw and wrote about some like...

I would say, sincerely nuts outcomes of this RAM shortage. What have you seen out there in the world? I think the one that's gotten the most reach is that some stores are now selling it like lobster in that they're selling it. like the catch of the day market price you have to walk into the store and ask hey how much is ram today or you might say you know i'd like to order The Ram. Can you tell me how much that'll be on my bill? Swirl your wine and I say, I'll have the Ram. Thank you.

It's the point where several of our Verge editors, myself, Richard Lawler, we've gone back and looked at how much we paid for RAM three months ago, six months ago, a year ago, and we've seen that the number is quadruple. What it was. Good Lord. I see Reddit stories about somebody talking about how they're willing to trade their pricey GPU for a couple sticks of RAM.

And a year ago, that would have been unsinkable. The GPU was the item that everybody wanted. You'd pay $1,000, $1,500, $2,000 for this GPU. It was that hard to get a good GPU. And now they're saying, oh, well, maybe I should get... $1,500 sticks of RAM instead for my computer. So my computer has enough memory to open my 100 Chrome tabs. It feels like we'd keep...

doing this. It wasn't that long ago that all the Bitcoin miners made it impossible to get GPUs, and then all the AI companies made it impossible to get GPUs. And then right before that, we had a chip shortage because everybody was in the pandemic buying like Pelotons and stuff. And so... Like, how is this just a thing that keeps happening? Like, at some point, these South Korean companies should just make more RAM. Why is this so complicated?

Why RAM Production Isn't Increasing

Some of it is that it takes a long time to spin up new facilities. There are only so many... ultraviolet, extreme ultraviolet lithography machines in the world. We're talking about dozens, not hundreds of those. Is that the thing that's made by that one secretly powerful Dutch company that no one knows about, but it just kind of runs the world? Yep.

If you want to make the cutting edge chips, this is the only company that will sell you the machine. You can't buy them if you're in China because they think that's a security risk. They have to fly parts. all over the world for this. It takes six months just to...

to take the parts for this machine and construct them into the machine. There are only dozens of them in the world. It's wild. That's for the cutting edge stuff. So there is not everything you're making is going to require the cutting edge machine, but still. I just have to say, I just Googled how much does DRAM manufacturing need EUV, extreme ultraviolet lithography.

And there's answers, but Google's AI overview is like, yes, it absolutely needs a UV lithography. Give it to me now, please. Like this robot is like, I need it. I need it right this second. It's very funny. It's on a curve up. It is not the dominant. Like Micron only just adopted EU. And Micron is building out more fabs. But to Sean's point, the fabs take a long time to come online.

There are so few companies that control this. There's the ASML, per year EVUV machines, the only company that's doing that. There's just the three memory manufacturers. When you come to the other side of the chip equation, TSMC, you know, the big Taiwanese fab company, they, I think the New York Times said that they, too, single company was producing something like 93% of the world's cutting edge.

chips at that at the time that New York Times report came out like a couple of years ago. So there's just power is in the hands of very few. And those companies, they don't want to. Risk creating oversupply. In some cases, it can be fundamentally detrimental is their bottom line. They could lose money if they do too much oversupply. I think Micron in particular is making massive profits now, but it wasn't always. There was a point one, two years ago that was losing a bit of money.

money um for the other companies they're like well we'd like to maintain long-term profits thank you very much we're gonna we're gonna feast on this as long as we can and not create more than we think we can sell and profit from. So they're happy to see their average selling prices go up. They're looking at NVIDIA becoming a $4 trillion company and going, well, that went well. Maybe we also can.

Future of RAM: Challenges and Solutions

Yeah. So that makes me feel like this thing is going to get worse and not better. It's not like I assume there's not some like next technology that is waiting to be implemented here. Like the world runs on RAM in a real way. Are we stuck in this sort of chaotic shortage for the foreseeable future? Or like, I guess if the AI bubble pops and all these companies go out of business, things change. But short of that, how does this get better?

One thought is that the AI bubble pops. Another thought is that maybe... One little thought. Yeah, so world economy crashes because the robot wants to bang you. Your laptop. It'll be easier to get a laptop, though. That's true. But at least Kevin Harris will find true love. Shout out to Kay.

Shout out to KR, my boy. Happy holidays, Kevin. Another thought. Another thought is that maybe, maybe they will come up with a version of... manufacturing ram that works better for the ai companies and they'll switch to that one theory going around right now is that today we make little chips on wafers and we You know, we cut out those little chips and we turn them into CPUs and memory modules and so on. But maybe in the future we will make giant whole wafer chips.

And because those whole wafer chips will be fundamentally much more efficient at moving data within them. maybe higher speeds for memory and so on. Maybe the AI company will switch to those. And so if the, I don't know where the bottleneck is, but if the bottleneck is not in slicing up wafers, but actually in printing out chips, maybe that will.

make the ai companies more happy wait i just the idea is that let's just say sam altman sam altman is going to buy 18 inch round memory chips that's basically that yeah basically i mean that's a perfect open ai idea Like we will get so good at manufacturing memory that the yield will be perfect on an 18 inch round silicon wafer. Sure.

This is how we get back to vacuum tubes. Do you know how cool that would look sitting on your desk right now? You're just like the Ram guys going up the stairs with their huge wavers. Like instead of dims, you're like feeding them in like giant CDs.

Hell yeah. Sure. Sure. I love it. There's also like other stuff. There's like packaging stuff. There's like 3d packaging, like all the same chip manufacturing stuff is in Ram now, right? There's lots of thoughts about packaging things differently, but. Again, I don't know where the bottleneck is. If it's, there's only so many wafers to go around, then we're kind of in trouble if the AI continues to eat all the wafers, you know?

If it's somewhere else, if it's in, you know, if we just package this differently, if we just manufacture it differently, and if that manufacturing can be spun out into a different supply chain that doesn't impact all the consumer stuff, that might be nice. Then again, I don't know.

Right now we're talking about the AI companies are talking a lot about HBM memory, high bandwidth memory. It's all it stands for, HBM. And so if you're going to use this separate kind of HBM to get more bandwidth in your AI data center. We're thinking that's going to steal RAM production away from the consumer stuff, from the DDR. It takes up three times as much space, according to one of the analysts that Emma talked to for her RAM report.

And so if that steals away, that's not good. But maybe we all start using HBM. There was an AMD set of graphics cards in 2015. I used one in a PC that used HBM memory, and it was great. It made for a very compact, efficient graphics card. perhaps all of that will trickle down. And after AI isn't heating up so much of things, maybe everything gets better in consumer as a result. I don't know.

Let's hope. All right. It's like the bubble pops, the AI build out works out, or we all transition to a new standard that's unproved. These are good outcomes. Perfect. We're doing great. And then you can finally buy a PS5. Like that's how it goes. Sure.

Mid-Roll Break and Games Introduction

Yeah, that sounds great. All right, we're going to come back to this thread of the story. But first, we're going to take a break, and then we're going to come back, and we're going to play some RAM games, which I am told are a thing that exists, and it's going to happen. We'll be right back. So you can feel confident.

you're finding top talent that you can't find anywhere else. And the best part is that those great candidates you're looking for are already on LinkedIn. In fact, according to LinkedIn data, employees hired through LinkedIn are 30% more likely to stick around for at least a year compared to those hired through the leading competitor. That's a big deal when every hire counts. With LinkedIn Jobs AI Assistant, you can skip the confusing steps and recruiting jargon.

It filters through applicants based on criteria you've set for your role. And surfaces only the best matches, so you're not stuck sorting through a mountain of resumes. LinkedIn Jobs' AI Assistant can even suggest 25 great fit candidates daily. making it easier and faster. to find top candidates. That's linkedin.com slash track to post your job for free. Terms and conditions apply.

Guys, thanks for helping me carry my Christmas tree. Zoe, this thing weighs a ton. Dursky, lift with your legs, man. Santa, Santa! He's talking to you, Bridges. I'm not that. Of course he did. Right, Santa? You know, my elf Drewski here, he handles the nice list. An elf?

I'm 6'3". What everyone wants is iPhone 17. And at T-Mobile, you can get it on them. That center stage front camera is amazing for group selfies. Right, Mrs. Claus? I'm Mrs. Claus' much younger sister. And at T-Mobile, there's no trade-in needed when you sweat.

So you can keep your old phone. Or give it as a gift. And the best part, you can make the switch to T-Mobile from your phone in just 15 minutes. Nice. My side of the tree is slipping. Timber! The holidays are better at T-Mobile. Switch in just 15 minutes and get iPhone 17. on us with no trading needed.

With 24 monthly bill credits for well-qualified customers, plus tax and $35 device connection charge. Credits end and balance due if you pay off earlier canceled. Finance agreement, 256 gigs, $830. Eligible port in a new line, $100 plus a month plan with auto pay, plus taxes and fees required. Check out in 15 minutes or less per line. Visit T-Mobile.com.

Zoe, the mall's about to close. It's impossible to do anything in 15 minutes. Oh, it's possible, Harvey. I mean, you can switch to T-Mobile in just 15 minutes. So, you think you can find your auntie a sweater? Come on, you spent an hour buying jelly beans. I know, I do love jelly beans. Trust me, now you can switch to T-Mobile in just 15 minutes.

just 15 minutes plus you'll get America's best network no no maybe I should switch to T-Mobile right now this holiday switch to T-Mobile in just 15 minutes from your phone When the holidays start to feel a bit repetitive, reach for a Sprite Winter Spiced Cranberry. and put your twist on tradition. A bold cranberry and winter spice flavor fusion, Sprite Winter Spice Cranberry is a refreshing way to shake things up this sipping season, and only for a limited time. Sprite.

The RAM Acronym Challenge

Obey your thirst. All right, we're back. It's time for some Ram games here on the Holiday Spectacular. What is this? What is happening to me? Ram games, Neil Hyatt. Get ready. This is what we do here. All right, Travis Larchuk, our producer, is here. Hi, Travis. Hello, everybody. Travis, you are in charge, and you have been let loose with several AI tools that make me nervous.

You're in charge. What do you have for us? I have two games for you today. The first game, Nilay, earlier you said this was a spectacular, not an acronym-tacular. Nuh-uh. You were wrong. Because this first game, as we all know, nothing tech people love more than jargony acronyms and initialisms. And as you know, RAM... Stands for Random Access Memory. In this game, I will give you an initialism for one point. Tell me, does this initialism relate to RAM in any way or...

Is it some random other thing that I snuck in there? I don't like that Sean is laughing in a way that suggests he's already won. I have to be really honest about this. I don't like this confident cackle that's coming out of my boy Sean Hollister. Look at, he's nodding. I gave you everything you need to win. Yeah, this is a question of whether Nila and I were listening. Are you listening? The initials came. All right.

Do we buzz in? How does this work? We will go in order. That's one point. Now, if the initialism turns out to indeed be related to RAM, there are bonus points available if you can tell me what it stands for. I will give you one point if you get... any of the words correct. I will give you two points if you get it all correct. Alright. Ready to rock? Let's do it. Let us randomly select the order of our game.

Oh my God. And Sean is up first. Yes. I vibe coded this in case anyone's watching this interface. I cannot wait for this thing to start hallucinating. Your first. Initialism or acronym is C-A-S or maybe CAS. This is RAM. It is indeed RAM for one point. Come on. Do you know what it stands for? Shit, what's the initialism? It has to do with latency, but why can't I remember any of the words in it? No, I don't know what CAS stands for.

All right. Cast stands for column access strobe. Oh my God. As in column access strobe latency. This is when RAM was made of like weird rods, right? Column access strobe is a vacuum tube. Yeah, you just pull the rods as fast as you can. You strobe the rods, boy. That's what they used to say. Strobe those rods. Sean, that is good for one point. Oh. Neil, I'm so sorry. What are we doing? Go ahead. I have good news for you.

Your initialism is DDR. Oh, that's great. It's Dance Dance Revolution. No, this is RAM. Double data rate. Nailed it. Two points. It is RAM. In the lead. Take that, officer. Double data rate. Three. Points. All three points. David. Just playing to Neelai here. I see. That's right. Your initialism or acronym is UNR. UNR. I definitely paid Travis under the table. I'm going to say not Ram. You are correct. It stands for the University of Nevada. Yes.

To be fair, I think you should have let me guess to get two more points. All right, Sean, we are back to you. Ready. You have UMA. That's Ram. Correct, for one point. Universal. It's also UMass Amherst, just to say. It's all universities. All the not Rams are universities. I don't know the M. Crap. Universal something axis, I think.

How do you not know the M? Just wait, wait, wait, wait. Think about what RAM stands for. Do you want to take a guess what the M stands for? Okay, let's try memory. I don't know. Okay, you are correct about the M. The M is memory. It is unified memory access. Unified. We're close. Wait, does he get two points because he got two words? No, it's one point. It's not one point per word. You get two points total. Okay. Yeah.

One point if you get at least one word, two extra points if you get all the words. Got it. This is when CPU and GPU share the same pool of RAM. Okay. Nilay. D-O-T-A. Perhaps Dota? I'm going to say not RAM. That's a game that uses a lot of RAM. Yeah, I'm just thinking of Vlad Silo and Dota 2. That is Defensively Ancient. It's an eSports game. David. All right, hit me. D-I-M-M. Dim.

It's a RAM thing. Correct. This has come up already. Do you know what it stands for? This has come up already? That seems bad. Data. David is memory master. Data intra-machine memory. You got memory. I get a point. It is dual inline memory module. To be fair, technically, I didn't get memory. Yeah, do you have to get one of the words right in the right place? Yeah, I had it on the wrong M. I think I don't get that point. The wrong M? All right. I'm actually willing to say...

What an upstanding guy. No, because otherwise you just get to say memory every time and you probably get a point. I understand how to score points, David. I'm kind of willing to say. Sean, you were making a face like you would have gotten this one. Would you have gotten this one? I would have gotten this one. 100%. 100%.

There was a big moment when I worked in the computer store in like high school where Apple switched from Sims to dims. And it was like all the talk of Macworld magazine in like 1998. That's why I remember this is just PTSD. You were pretty cool in high school. I was the shit. All right. At the end of the second round, our scores are Sean, three, Nilay, four, David, two.

Nilay with the easiest three points anyone's ever gotten. I would have gotten dim. You would have. That's fair. All right. All right. This is the last round. Sean, CTU. Not a Ram thing. That is correct. That is the counter-terrorist unit from TVS24. All right, Neelai. ECC. That is RAM. That is? Error. Correction circuit. So close. Error correcting code. I knew the first two were. That was good.

This allows RAM to catch errors and is generally used for mission-critical systems and not in consumer PCs. All right, David. Mathematically, no way for you to win, but let's find out what happens. That's David's middle name. With HBM. High bandwidth memory. Hey. Correct. Thank you, Sean Hollister. Thank you, Sam Altman, for your giant wafers. We are playing the games first next time. Next time we're playing the games first, explanation comes after.

Somehow we end the game with Sean with four points, David with five, and Neelai with six. Congratulations. Feels right. Sean, clearly the least educated about Ram. I take it on the chin.

White Elephant RAM Gift Swap

Okay, your next game is on screen now. As we all know, RAM is the most valuable resource in the world right now. It is Mad Max times, but for RAM. So we are going to play a white elephant gift swap. where the object is to end the game with the most RAM. Here is how it will work. I have nine secret gifts that are wrapped in Verge wallpaper. Each is a gadget containing an amount of RAM.

I will not reveal how much RAM until the game is over. Before anyone writes in, I know that not all RAM is created equal, but for the purpose of this game, we only care about quantity of RAM and not quality of RAM. So DDR4 versus 5. We're cool. Exactly. It doesn't matter. It's all worth the same. Because I heard we're phasing out DDR4. I don't know if you're taking that into account here. I heard that, and I have not taken it into account.

All right, so on your turn, you will choose. This is like a white elephant, Yankee swap. You will choose to either open a new gift, a random gift, or you can steal a gift from another player. If a gift gets stolen, the victim of the steal can then choose to either open a new gift or steal a gift from another player. Each gift can only be stolen one time per round.

And if a new gift is open, the round is over and we go to the next person to start the next round. Once everyone has three gifts, we will play one more round because the person who opens the first gift has no choice during this game. In that round, your choice will either be to swap one of your gifts with somebody else's gift or to end the game. Okay? All right. So we will randomize our order to find out who will open the first.

What if I don't want RAM? What if I want the other stuff? Well, that is up to you. Are you looking to win? In the one with my wife's family, everybody wants the lotto tickets. That's the way it goes. All right, Neelai, you get the first pick, so it's just one through nine, and that's all you get. World of no sevens. I'm going eight. Eight. Gift eight is a whoops palma. Perfect. Congratulations, Neelai. Nailed it. You waive it. Technically, that contains RAM.

It does contain RAM. David, you could either steal that from Eli or you can open a new gift. This is maybe the one advantage I have over both of you is I know off the top of my head how much RAM the book's on my head. I'm going to open gift number four. Gift number four. You have a shiny new Cybertruck. I am less aware of the amount of RAM in that device. We are talking about the amount of RAM in the Cybertruck's entertainment system specifically.

So, Sean, you can either steal Neely's Books Palma, David's Cybertruck, or you could open a new gift, Sean. I don't want to end with a Cybertruck. Also, Verge wallpaper number seven is delightful, so I'm taking that one. I love this purpley reddish blue wallpaper and you got meta Ray-Ban display. Oh, all right. Neelai, you can steal any of the gifts that are out there or you can open a new gift. This is.

Our second go-round here, round four. I like debating whether or not the Cybertruck has more RAM than the Boost Palma. It's a real toss-up. Let's open number three. All right. You're going to open gift number three. No stealing so far. That is a iPhone 13 mini. Rough. Huh. The favorite phone of many a Verge podcaster and listener. Loved it.

So good. Okay. David, you can steal any of the gifts that have been opened or open a new gift. So the dilemma here is, did Travis pick a bunch of things that don't have much RAM, or have we just opened the things that don't have much RAM? I was doing the same calculation. I am going to make a potentially reckless decision and I'm going to steal the books, Paul. Yeah.

All right. Which I think has a non-zero chance of having the most RAM of anything on the board so far. David stole the books Palma from Neelai, which means Neelai, you can now make a steal yourself or you can open a new gift. I'm taking the Cybertruck. Straight swapping. Eli steals the Cybertruck from David. David, it is your turn to either steal or open a new one. Give me number two.

All right. Gift number two is. Neil, do you agree that the Cybertruck either has one or a thousand gigs of RAM and like nothing in between? Yeah. My bet, I was doing the same calculation as you, and I was like, I know that the Pooks Mama doesn't have a lot. I'm going to roll the dice on the Cybertruck. Also, it was only fitting that I end up with the giant wiper in the end. Agreed. The Switch 2, this is a good get.

Yeah, I'm going to keep the Switch 2. I feel good. I'm psyched. Are you going to keep the Switch 2, though? I'm not sure if you are. It is Sean's turn. I am, in fact, taking the Nintendo Switch 2. The Nintendo Switch 2 has been stolen. What's the maximum number of steals? Each item could be stolen once per round. So like I can't take it back. Right. But I could in theory take the Cybertruck. I'm going to open number five. Number five is... The Jumaine AI Pen.

This is so cruel and also the fact that I'm going to end up with the books Palma and the Humane AI pin feels like I deserve this. You totally do. My 2025 suggests that I deserve this. Wait, so if there's not a maximum number of steals, the endgame here gets very complicated. Yes. So yeah, each round, each item can only be stolen one time in a round. But after that round, things are open to be stolen again. But then there's a swap at the end. There is a swap round at the end.

Just to recap for the listeners, Neelai has an iPhone 13 mini and a Cybertruck. David has a books palma and a humane AI pen. And regrets. And Sean has meta Ray-Ban display and Nintendo Switch 2. And it is Neelai's turn. Can I just pause, by the way, to say that so far we have accidentally kind of all three picked our personalities? I was going to say, is the goal to wind up with the most fitting items? All right. The only correct move right now is...

to pick a new. So I'm taking number six. I think that's right. Number six. The game theory is afoot. A Pixel 9a. You did pick stuff with not enough RAM. One of these is going to have... This game is going to be made... or broken on like 16 megabytes of RAM. I can see it coming. There's going to be like a Mac studio at the end of this that just wins. And none of the rest of it's going to matter. Holding out for...

Framework desktop. I do have two tiny little phones. It's adorable. And a cybertruck. I didn't say that was adorable. His two cell phones and a cybertruck. Red flags all over the place. Have you heard of Bitcoin? Give me the Switch 2. All right, David has stolen the Switch 2 from Sean. Sean, you can steal or open a new gift. But I can't steal the Switch 2, so I think I'm going with number nine. Everyone loves it.

He's opening a new gift, and the gift is a Galaxy Z Fold 7. Now we're talking. That feels like it has a lot of RAM. I know exactly how much. Sean, it is also your turn to start the ninth round. There's one gift left. I'm taking the Switch 2 back. All right. Sean takes back the Switch 2. I can't take it because I'm still in the same round, right?

Right, but you're going to get to go next. Got it, I see. All right, give me number one. Let's do this. All right, David is opening number one, and number one is an Apple Vision Pro. What? How did he pick so poorly? Wait, okay. Serious question. For the two of you looking at this, do you have confidence about which one of these nine things has the most RAM in it? No. I think it's a Cybertruck.

So I think there's a chance it's the Cybertruck. I also think it's possible that I'm just dead wrong. But okay, I have the vision. Great. I have a books, Palma, an AI pin, and a vision. This sucks. I'm sorry, dude. No one wants to go to your house. I want to try out the Apple Vision Pro. Yeah, Travis, you can come over. Everybody else is uninvited to my holiday party. Yeah, David, look at you with his dead glowing eyes. Inside it is a ram-starved headset.

All right, this is the 10th and final round. Neelai gets to start this round because he went first and didn't have a choice in the beginning. On your turn, you can either swap one of your gifts with one of anybody else's gifts or just... end the game send me life It is your choice. All right, I'm going to swap the 13 mini for the Switch 2. I feel good about that decision. Okay, Neelai is stealing the Switch 2 from Sean and giving Sean the iPhone 13 mini.

Sean, it is now your turn. You can swap or end the game. You have meta Ray-Ban display, Galaxy Z Fold 7, and the iPhone 13 mini. I am going to take the Vision Pro for the 13 mini. Okay. Giving David the 13 mini. Finally, David has one useful device. David, same choice. Swap or end the game. End my pain now, Travis. There's at least one move on that board that I would make. There's two, but I'm ending the game. I'm dancing with the ones who brought me. Let's do this.

Guess what's going to happen when the humane pin turns out to have 32 gigs of frame. Let's go. David hates this game. All right. We are ending the game with Neelai having the Nintendo Switch 2, a Cybertruck, and a Pixel 9a. Yeah. Party. David books Palma. He made AI pin. iPhone 13 mini. uh spoiler alert is going to lose the game and sean meta rayband display galaxy z fold 7 and an apple vision pro all right we all have a phone we all have a phone

You can all call each other. This is great. Let's find out how much RAM. Ring, ring, David. How's that humane? It's okay. I'm looking at you on my laser projector. David, how much RAM does the Books Palma have? I believe it's six gigs. It is six. Wow. Humane AI Pen has four. I was going to guess four. I'm going to guess the 13 mini also has six.

Four. A total of 14. Tough day for Dan. All right. Neelai, we're going to go to you next. Nintendo Switch 2, does anyone know how much? My guess was 16. That was what's in my head. It is. 12. All right. Cybertruck. It's either zero or 1,000 for David. 64. It has. 16? 8 gigabytes of RAM. That sucks so bad. It has more inches of wiper than RAM. Oh, brother. And the Pixel 9a has eight gigabytes of RAM. All right, I feel good about this. Nilay's pink phone and his truck have the same amount of RAM.

All of those things are like influencer gadgets. That's what I'm doing. All right. Neelai has vaulted into the lead with 28 gigs of RAM. Sean, I've got a good feeling about this. Your meta Ray-Ban display. Does anyone know? I don't. Not even the best. Rough start. Big win for the AI pin, that one. Galaxy Z Fold 7 has 12. And this is the base Z Fold 7. 12 gigabytes of RAM. All right. Sean has 14. Eli has 28. The Apple Vision Pro has 16 gigabytes of RAM.

Giving Sean the win with 30 gigs of RAM. Wait, David, you would have won if you had held on to two things. I think you would have won, right? Sean took the Vision Pro from me. I wasn't given that option. Yeah. I got you. Damn. Well played, Sean. I also really respect that you had both the most and the least. You're a full-spectrum RAM guy. My bet was that Apple always starves everything for RAM unless you pay an additional $800. So I was out in the Vision Pro.

Yeah, but it's $3,500. I think we paid the additional $800. Fair enough. My assumption was that Samsung overstuffed the phone with RAM. Wait, can you buy a Z Fold 7 with additional RAM? You can. The highest end model, I believe, has 16. That is ridiculous. You should not be able to change the amount of RAM in your phone. So I have a Palm Pilot here. Anyone want to guess how much RAM is in here? 256 megabytes.

Oh, it's a SIM. I have a stick. It has two megabytes. Two megabytes of RAM. Incredible. That's wonderful. Back when a megabyte was the size of your thumb. Those were the days. All right, Travis, this was delightful. Thank you. Congratulations to Sean. Congratulations to Eli. I lost, you know, magnanimously as the host, just so everyone's very clear on that.

We need to take one more break and then we're going to come back and we're going to get back into talking about the ship horse. We'll be right back.

Mid-Roll Break and Interview Introduction

DIY or let us install free design consultation Plus free samples and free shipping. Free, free, free, free, free, free. Head to blinds.com now for up to 45% off site-wide plus a free professional message. La, la, la, la, blinds.com. Rules and restrictions may apply. How can we get someone to not only listen, but truly understand where we're coming from? I'm Preet Bharara. And this week, Dan Harris, founder of 10% Happier, joins me to break down how to talk to someone you disagree with.

the most effective, benevolent form of manipulation I've ever encountered. A little game I play during the course of my day is to see how many times I can get my interlocutor, the person I'm talking to, to say the word exactly because they feel heard. Once you've done that for people, they eat out of the palm of your hand. Plus, how small actions seem to cause the biggest change. The episode is out now. Search and follow Stay Tuned with Preet wherever you get your podcasts.

If you were a person online around the turn of the century, there's a good chance that AIM, AOL Instant Messenger, was crucially important to your social life. For a whole generation of us, it's how we learned to LOL and LMAO and JK and BRB. It's how we learned to be people online. And this week on Version History, a new chat show about old technology, we're talking about the whole story of AIM.

from its skunkworks era inside of AOL to its very sad death at the hands of text messages. All that on Virgin History, wherever you get podcasts. This week on Net Worth and Chill, I'm joined by Dr. David Kim, board-certified dermatologist, founder of Lightsaver Sun Care, and the minimalist skincare expert with nearly 700,000 followers.

who's changing how we think about investing in our skin. From Stanford Medicine to Sephora shelves, David's journey from clinical dermatologist to entrepreneur and creator economy powerhouse is a masterclass in turning expertise into multiple revenue streams.

He's breaking down the truth about what skincare products and treatments are actually worth your money. Get ready for a conversation that'll save your finances, clear up your skin confusion, and prove that sometimes the best investment is the one staring back at you in the mirror. Listen wherever you get your... podcasts or watch on youtube.com slash yourrichbff. All right, we're back.

Chip Market's Cyclical Nature

Neelai is gone. Sean is still here. I rearranged during the break. If you're watching, please clap. And we have replaced Neelai with somebody much better. Dylan Patel is here from Semi Analysis. Dylan, welcome. Thank you for having me. Real quick, I assume, you know, most people, the brand penetration of semi-analysis is like right up there with like Coca-Cola and Walmart these days. But like, what is semi-analysis? What do you do? Yeah, so we're a firm that does AI infrastructure.

research, consulting, et cetera. Started five years ago as just a blog and me consulting on the side after I quit my job and it's just sort of blown up and up and up and now I have a very famous blog as well as, you know.

You know, companies, 50 people, you know, all up and down the stack having worked on, you know, equipment that makes chips all the way up to like worked at data centers, worked on models and things like that. So we do a lot of consulting, research, etc. Okay. So I want to start with a question. that is sort of about the timing of launching your company, but is also just about this market in general. What I'm wondering is like, is this just what the chip market is like? Did you pick?

just sort of the beginning of the most bonkers time in Chip's history to start doing this? Or is this just how Chip's work? I mean, absolutely today is the most... exciting time ever the ability for people to make the biggest change ever right like I think it's the craziest time ever but

Chips have absolutely just been bonkers right now. Parts of it are like annoyingly slow and parts of it are not. But you have to think about the market for, let's just take DRAM, right? Memory, prices are soaring. People freaking hate DRAM right now, especially. general public. But...

What's interesting is this market has existed this way for years. And if I go back a decade when I was more of a forum warrior on Reddit and stuff, every three to four years, people would be oscillating between, oh, memory's so...

cheap i'm going to put way more memory than i need and people and then and then in my pc or whatever and then and then oscillating to like oh my god memory prices are so high they're colluding against us they hate the the you know american public they hate the public in general um i think i think Semiconductors are a very tough business, right? Memory specifically went from like over 30 companies on the leading edge to just three, right? And in a couple decades, right? Every boom and bust.

more companies go bankrupt. The barrier to entry is so high, despite the fact that there is an oligopoly of sorts in many industries. In fact, most of the semiconductor industry is sort of leveled out to like, hey, there's a player with like 70% share, there's a player with like... 25% share and there's like this crappy company with 5% barely hanging on, right?

And obviously things are dynamic because it's technology. So shift stuff does shift. But at the end of the day, there's the barrier to entry is so high. The dynamics of the market are so intense that people are just going bankrupt left and right. That it's just it is a bonkers industry. And I've always thought it was bonkers.

Unprecedented Bust and AI Boom

you've had these booms and busts, you've had this cyclical nature of the industry and you get smaller and fewer players, but it's never been like... this before right i i've had i've seen low memory prices and i've seen high memory prices but i haven't seen um there are only three players and one of them is getting out of the consumer market and the consumers it's not just that they can't buy it because it's high prices it's that

The supply isn't even there because there's an entire new industry eating up all this DRAM. It's never been like this before, right? I definitely agree. If we're just talking about memory, we have seen prices spike about this fast before. Over the last six months, like 50%, 75% increase in... contract pricing spot pricing has risen more um but even even then right like i think we've seen this level of uh price increase

the thing that's really going to break everyone's brain is the next six months, it's also going to do that again, right? It's going to double again, right, in price or something like that. And that's what's going to really make people go crazy. And I think... The funny thing is, or not even funny, like I think just like the sad thing is, the reason we're in this position is because this is actually, when we talk about the boom and bust of the memory industry.

2022, you know, PC boom, all this huge amounts of memory was being deployed because everyone's just buying a new PC. And, you know, the memory companies built a lot of capacity. And then all of a sudden... Oh, wait a second. Everyone has a new PC. I keep my PC for seven years, right? Like, why do I need a new PC as an enterprise or as a person, you know? And the PC market falls off like a cliff and these memory companies are now losing money every quarter.

And so from 23, 24, 25, they were not adding new wafer production capacity. The only thing they were doing is as AI came into vogue, they were converting the regular memory production to HBM. Right. And so this has been the longest uninterrupted period of no capacity expansion as well.

Right. So, so this boom and bust, and then also it was the worst bust, right? One of the worst buses like sustain multiple years of losses rather than just like, Hey, a year or six months because the boom of PC and COVID was so large. Right. So you kind of had this like, like. of like, oh my God, everyone is, we just haven't added any capacity. So like, and then on the flip side, we have the craziest boom in human history, right? Like, you know, I think AI infrastructure.

Industry Caution Amidst AI Demand

is undoubtedly like you know the biggest boom in the chip industry on a dollar basis there's one way to look about this where we're looking at like these companies there's so few of them and they can make these massive massive profits all of a sudden but another way to look at this is a couple years ago, Micron was actually losing money. I don't mean like the revenue was going down. I mean like it was in the red, right?

With actually losing money? Yeah, for over a year too, right? It's not even like a little bit of time, right? They had to do layoffs. They like shut down factory lines, right? Like all of this sort of stuff, right? Samsung, Hynix, and Micron, all three of them had to do this, right? So the sort of like...

you know, I would say the more nuanced view is like, yes, they, you know, this is crazy and the prices are soaring. At the same time, they kind of had no choice to, you know, like, you know, it's like who would have increased production after you just got out of the red? a year and a half ago. That's just silly. No one could have predicted this. That is my question, though, because...

Even if it's possible that there's nothing we could have done about it, even if it was inevitable, right? Which I think you just made a solid case that it is. Shouldn't we all have seen this coming? Shouldn't like all of those things that you just described are like three year old trends now. And if they're not that hard.

at least in retrospect, to put next to each other and be like, oh, of course we were headed towards something totally disastrous here. The thing about this industry is that it's very easy to be bullish, but the most bullish person tends to go bankrupt. Right. And so that's the scary thing about this industry is if you overbuild the most, you end up going bankrupt. And that's how we've gone from 30 to three. Right.

And so as far as like, has anyone seen this? Like, of course I could show myself and say, look, we told all of our clients, we modeled all this production capacity. We modeled all the AI production demands from a data center standpoint, from an accelerator standpoint, flowed through how many wafers. required blah blah blah blah yeah obviously we've been writing about like memory is going to go crazy for the last year and a half roughly right um and

But at the same time, it's like, you know, I'm not someone who managed a company, you know, through the last 30 years where 27 competitors went bankrupt. And the scars are there, right? The industry has these scars. So there's also that front of like, is this a bubble? Well, I've seen...

15 other bubbles and that's bankrupted all my competitors. Why would I go crazy this time? Was there anybody, though, who was predicting this, who's like the guy who saw the subprime mortgage crisis coming? Was there anything like that? Because I feel like what I'd heard was DDR4 prices are going to rise because, you know, it's the old standard. They're not going to be producing as much of that anymore.

Let's get ready for DDR5. And then it felt like it was a surprise that DDR5 was in this huge crunch, that these data centers wanted so much of it. And even the companies that make their business on this, Dell, the COO of Dell is telling. My focus now is to make sure we have supply as if his company hadn't inked deals years ago to make sure that they have enough supply for their consumer products, for their commercial products.

AI's Inelastic Demand vs. Consumers

Yeah, so at the end of the day, the memory market is kind of a funny one in that you can say ODDR4 pricing is going to go up because it's going out of production, but on the wafer production level, right? There is sort of like the differences between DDR4, 5, HBM, there are some process differences, but those process differences are not like, oh, it's a separate factory. It is the same factory. The time to change from one to the other is not that long.

right um you know in the case of uh dr4 to 5 it is just a mask change which can take hours. Now, obviously, the production timeline to make memory wafers takes months, right? But the timelines to change stuff is quite quick. What it is is that they just didn't add wafer capacity, right?

Now, whether that wafer capacity goes to DDR4, HBM, or DDR5, there is some differences in sort of like, what's the capabilities, right? Samsung's not that great at HBM, but they're great at DDR5, right? Like sort of like, you know, there's these sort of mixes. and discontinuities in the market. But at the end of the day, you know, the market is pretty efficient and the margins for each don't differ that much, right? For DDR4 versus 5 versus HPM. So what's happened is just that...

Memory AI is a sort of inelastic buyer, right, if you will. NVIDIA buys, you know, let's take Blackwell, right? Blackwell GPU, 192 gigabytes of memory. You know, that... that GPU NVIDIA sells for over $30,000, right? But at the same time, that GPU costs them like six, $7,000 to make. And of that memory is half the cost, right? But if the memory cost goes up 20%,

well, they're still selling this chip for 30,000 plus, right? So, you know, if it goes from six, 7,000 to 8,000, you know, their elasticity there is not crazy. You know, who the elasticity is crazy for is the PC buyer. the mobile phone buyer there the phone costs you know or the or the laptop cost whatever it is and if the price of memory doubles and it adds a hundred bucks to the cost of the device then all of a sudden

you know, guess what? I might not buy, you know, I might not, or it costs even more than that, right? Like I might not, you know, that thousand dollar laptop, you know, for a little bit, there were even thousand dollar laptops with 32 gigs of RAM. And it was like glory. glorious now now like you you know it's kind of harder to find and i bet next year it's gonna be even tougher right um and so there's there's sort of that that interaction in the market

in that, like, who is the elastic buyer? And unfortunately, the consumer is the elastic buyer. You know, the production, you know, AI infrastructure spends going from like, you know, you know. 10 billion to 100 billion to a trillion, right? Like we are scaling like crazy. And if it gets to, you know, next year, we look at, you know, the big top five hyperscalers.

They're going to spend our top six hyperscalers, right? Google, Microsoft, Amazon, Oracle, CoreWeave, I'm missing one, Meta, right? You're looking at $500 billion of spend across them. right, on AI infrastructure. Of that, their spend on NVIDIA's is like $300 billion. And of NVIDIA's $300 billion, that spend on memory, you know, after their margins, you know, NVIDIA's largest supplier is SK Hynix.

a memory vendor. It's not TSMC, right? So you float through and it's like, okay, actually next year, the gross, the total volume that AI is consuming is ridiculous. And as far as like, hey, did anyone see this coming? There are a lot of people who are speculatively buying and things like that because the dynamics of the market are clear, right? So if you look at like, there's, I don't remember which PC maker it was, whether it was Dell or Lenovo or HP.

but one of them actually was super smartly about two quarters ago, secured a bunch of DRAM ahead of time. And their stock, like there was a call on the earnings call where their investors were like, why did you, why did you enter all these long-term supply agreements? Like, you know, you shouldn't do that. You should be.

just-in-time inventory, right? Like they were kind of like criticizing them like the Wall Street person. And then now they're looking pretty smart because they secured memory at a lower price longer term, right?

But at the end of the day, right, like not all of the memory is, the other aspect of this is like this area for AI, the HBM, right? That manufacturing process is a little bit more complicated. The suppliers are even fewer, right? Samsung's not so good at it. So NVIDIA locked in their supply for HBM.

totally next year but this funniest thing is because sk hynix is the best and because they have the best hbm and nvidia decided i'm going to sign a big contract with you at good margin all of a sudden sk hynix is going to be the least profitable of the big three memory vendors because they don't get to sell all their memory at this

Scale of AI Data Centers and Entry Barriers

super inflated price set because the market is going crazy. So we've laid a lot of the blame for a lot of this kind of at the feet of AI data centers. But I think for people who don't... follow this stuff all the time. These just seem like large buildings full of computers. And I think it's hard to put into real terms how big a project this actually is.

Can you give us a sense of the scale of the build-out of the AI data center right now? If we go back just a couple years ago, there were 4,000 or 5,000 data centers in the world, but none of them were super, super big. The biggest data center in the world three years ago is... laughably small compared to what's being built now, right?

uh you know the largest data center building in the world was you know maybe you know 50 megawatts 75 megawatts etc in that range um google was building one that was like 100 megawatts i was like whoa uh now when you look at like the size of like some of these campuses right it's like oh star

gate in abilene texas is two gigawatts um it actually that one is kind of small relative to some of the stuff that's going up which is five plus gigawatts right uh you know met has talked about like their louisiana stuff um the the uh The concentration of value within a data center is absolutely absurd, right?

You think about it again, right? This area of Manhattan, it's five gigawatts. Five gigawatts, once Meta builds this entire Louisiana facility out, five gigawatts size of Manhattan, it ends up being the entire cost that they put into it was on... the order of roughly $250 billion, right? $250 billion for one site in Louisiana that they're building over a couple years, which by the way, those GPUs are not going to be...

you know, bleeding edge in five years, right? They're going to be, you know, they'll still be, they'll still be maybe useful in five years, but definitely in seven or eight years, they won't be useful. It's just an insane factoid because when you think about it, it's like, you know, like.

It's hard for humans to understand what $250 billion even means, right? That's more money than the richest person in the world has. But again, we can't fathom what the richest person in the world even has. So it's just like there's no way to contextualize this. If that's where we're headed, a different market would suggest that the next thing that's going to happen is we're going to get a million.

chip startups who are going to come and try to make all of this stuff. And they're in the like, your margin is my opportunity, right? That's this moment that we're in. And every academic, everybody who's interested in chips, you should quit your job and go start a chip company.

This is the gold rush and we should be getting an entire new generation of folks coming out and saying there's only three companies doing this. Let's get it back to 30. Let's get it to 300. And there's going to be demand for this going forward. Is that happening? Are we headed down that road? And if not, why not? So there's two sort of layers in this stack, right? There is the design companies and then the manufacturing companies.

As far as the design companies, there are some startups. Many of them are going to fail. Maybe some of them will be successful. But that's true of all startups, right? This is not necessarily a wildly different kind of thing to try and do. Yeah, but in terms of design, like the barrier to entry is there, but it's not insurmountable, but it is a high barrier to entry, right? You have to design your chip and then tape it out at TSMC and all this costs, you know, 50 million plus dollars.

And if there's any issue, you got to do it again, right? So there is a barrier to entry there. That barrier entry is really low compared to manufacturing, right? We are not going to get many new memory companies. There is one new memory company, but that's because it's like a national level like priority from China called CXMT. But they're like, they have national government backing.

Um, we're not, you know, we're not going to get a new memory company in the West. Um, just, we just aren't right. Um, or, or in, in, in like Taiwan or Japan or Singapore or any, anywhere else, right. In the West, like, you know, there's just not going to be a new memory company because. The physical construction of a fab is tens of billions of dollars, right? Plus...

all of this know-how that is super trade secreted and super confidential. And it's built upon year after year after year of tens of thousands of people's R&D who are all super, super smart, like PhD level engineer.

and researchers just building and building and building and it's incrementally building on top of each other, right? For context, right? Building a chip, right? You know, like a leading edge chip, whether it's memory or, you know, say a phone chip, a phone CPU or phone memory, right? Or laptop. memory or laptop chip. That takes over 5,000 process steps, right?

Where you take a perfectly, you know, you take a silicon wafer. It's a perfect crystalline structure. Then you bombard it with ions. You deposit materials. The ions is for doping. Like you do lithography to define where things are and you build.

Beyond DRAM: Innovation and Geopolitics

this chip layer by layer by layer by layer by layer and any defects ruin the chip. So then the other thing that might happen, it seems to me is like the other thing you would hope for at the end of this is this is where we get the next breakthrough.

Right. And you've written about this. I found a blog post you wrote a couple of years ago basically saying we're sort of at the end of DRAM anyway, that it can't scale the way that it used to, that other parts of the process are kind of leaving its abilities behind and that maybe what we need is something beyond.

DRAM. And again, we have perfect market conditions for somebody to show up and say, actually, I've found something that I can make cheaper or I can make with a different set of materials that is less.

you know, reliant on one multimillion-dollar machine from a Dutch company that has to fly in on a Boeing 737. Is that happening? Like, is there a science breakthrough here somewhere? It takes multiple... planes not just right it's multiple so if we can just get it down to one 737 we will have done something is there is there any inclination of that on the horizon here yeah so so um

The interesting thing is like when you look at, you know, just I'll zoom out to just like generally semiconductors that sort of had Moore's law, right? And Moore's law was actually originally about DRAM, but people just sort of prescribed it to logic as well. Is that true? I didn't actually know that.

Yeah, Gordon Moore was talking about DRAM. That's what Intel made at the time. They actually lost it. They were one of the companies. They didn't go bankrupt. They pivoted to processors. But they had to leave the DRAM market because they were getting, you know, the market was too tough. Anyways, the number of transistors doubling every two years, again, in an area like...

butchering the definition, but whatever, happened for decades, right? And Moore's Law was made before Intel's 8086, right? Like the initial coining of it, right? It was actually when they were making only DRAM. It happened for decades, decades, decades, and costs kept going down.

As far as the general DRAM vendors, they do have a roadmap to continue to go 10%, 15% cost reductions a year for another decade. They have some, you know, they have some innovations that they want to do over the next five years, next seven years about change.

the structure of DRAM and such. But the next big one is sort of 3D DRAM, right? So interestingly enough, NAND flash already went through this. The cost reductions asymptoted out. The physics just didn't let you shrink it smaller and smaller.

NAND ended up having this big revolutionary update where instead of doing planar NAND, they did 3D NAND. And so they can make many layers at once, right? And that ended up resuming the cost scaling curves for NAND. And that's why SSD prices have fallen so much over.

the last decade. And even the last five years, yes, market dislocation right now, but generally prices have fallen a lot, whereas DRAM has not really fallen much. And so if they can figure this out, that's what the DRAM vendors are all in on, right? But that means...

that they're sort of, they're all in on, but so is their supply chain, right? Applied Materials, you know, LAM Research, you know, ASML, all these companies that are in the equipment supply chain, all of their R&D effort is also focused for memory on helping these companies figure out 3D DRAM.

because that's what they need next to keep scaling and keep the market growing and keep the industry moving forward. You mentioned China. You mentioned China earlier that there is the state backing there for one company in particular to start making a dent.

The big companies, you know, SK Hynix and Samsung and Micron, they're making a lot of this stuff in China too, right? What keeps China from taking over? So as far as what they're making in China... um the vast majority of sk hennicks and samsung's capacity is in korea right the vast majority of micron's capacity is in uh singapore um and uh japan

Taiwan, and the US, right? Micron has no capacity in China. Hynix and Samsung have some, but that's old capacity and they actually haven't upgraded it in a long time. With that said, you know, what prevents China from learning is like, I mean, it's just a ton of hard engineering, right? You know, there's a bit of like, oh, people who worked at these companies coming back and being hired. There's all this sort of like claims of like IP theft, blah, blah, blah.

end of the day, it's like, look, there's a ton of engineers who are working really hard and they have effectively unlimited money, right? And even then, China still has not been able to, you know, in 2015, they released a five-year plan, which was what their targets for semiconductor production in 2020 and 2025 were. And they did it again in 2020, right?

And they've missed every time despite the fact that they've poured hundreds of billions of dollars. Now, that's not to say they didn't make progress and that they're not going to get there. They will. I do truly believe it. Chinese engineers are really good, right? It just takes a really long time. Now, I don't think this is something a venture-backed business can just do, right? That amount of money is really nation-state level stuff.

And that's the challenge. And as far as China, the next breakthrough away from DRAM entirely could come from China as well. There's no reason why it wouldn't. It's always easier to leapfrog than it is to incrementally catch up. Is this the moment, though?

with with the the export controls and trump playing the games around you know who can and who can't get nvidia gpus and the national security concerns in the united states about do we want to let china have all the gpus is now the moment that the nation state changes its tune and says we're gonna we're gonna 10x that you know investment in these companies to make it to make it happen do you see the china becoming

a global power in logic and in memory the way that we already know it's a global power in all the other ways.

When Will RAM Prices Stabilize?

Yes, I think that's absolutely going to happen one day, right? China is going to catch up. I want to just go back to the thing you alluded to at the very beginning, which is my last question for you was going to be, when does this get better? When does my computer get cheaper again? And I think the answer is, A, maybe it doesn't. And B, it's certainly not happening anytime soon. Is that right? Basically, about last year, this last year.

Hynix, Micron, Samsung, they've decided to start investing in building new fabs again, right? Instead of just upgrading old fabs, keeping the old fabs going, changing the process, blah, blah, blah, they've decided to build new fabs. two-ish years or three years, depending on the timescale of the construction progress. So in 2027, we will have new wafer capacity coming online.

And you're literally just talking about like the time it takes to build a building, right? Like it's not, there's not some like magic they have to do to set up these new fabs. It's just literally like they have to go do large scale construction. It's large-scale construction in the cleanest environment humans have, which is a clean room where there's less than a particle.

you know, a million, you know, like the million particles per square meter or whatever is like absurdly low, right? You know, to the point where like human like skin flakes are the most dirty thing in the like, you know, like fab, right? And that's how you wear the bunny suit. There's... all the complex chemistry, right? They have like all these sulfuric acid and hydrochloric acids, and they have all these different chemicals like photoresist. There's thousands of chemicals used, right?

There's these tools that range all the way from these like 200, 300, 500 million dollar tools that get flown in on multiple 737. The human logistics required to build these fabs is absurd. And so, yeah, it takes a couple years. And then setting up the fab, making sure it's clean, running the process, etc. Best case, prices get cheap again in 2027. Or continue to fall again in 2027. But...

Depends on what happens with AI. Because as I mentioned, everyone who's building these fabs is super conservative, right? There are these 55-year-old men who have seen many busts. And if you take what... our predictions for AI supply chain demand or, you know, anyone else who's sort of like super in tune with this, what we think, you know, the number of GPUs, the types, the memory, all the volumes required, actually prices will get worse in 27 too.

But that's if AI doesn't pop as a bubble, right? Now, I'm a maxi. I don't believe it'll pop. I think there's trillions of dollars of economic value that will be delivered through AI over the next few years. you know, that's, that's me. But if you do believe AI bubble will pop, then 27 will have cheaper prices. If you think AI, you know, just continues to go, then we're screwed. And actually memory will never be cheap again. And we might as well like stop using our computers.

It is truly wild that you actually have to make your computer buying decision in 2026 based on macroeconomic and giant geopolitical headwinds. This is where we are in the world.

Episode Wrap-Up and Future Shows

Should I buy a Dell XPS 13 is actually a question about like the state of the economy in the world. This is why we do an hour on RAM, friends. This is what we're doing here. All right, Dylan, Sean, thank you so much. This has been delightful. I appreciate you both doing this. Thank you so much.

All right, that is it for the show. Thank you to Nilay and Sean and Dylan for being here. And thank you as always for watching and listening. This is actually our last VergeCast of the year. We're all going to disappear into the holidays for a couple of weeks and we will be back.

in the beginning of January for CES. We're going to do an episode kind of right as all the news is happening. And then we're doing a live episode on Wednesday, January 7th in Vegas at the Brooklyn Bowl. So mark it on your calendars. It's going to be in the afternoon.

Come hang out. Come VergeCast. We're all going to go bowling. I've never been bowling with Nilay. And I have this sneaking suspicion that he's either very good or like hilariously terrible. And I'm very excited to find out which one it is. So come bowl with us. Watch the VergeCast. It's going to be very fun. Also, in the meantime...

There's a bunch of decoder for you to catch up on. We have a couple more version history episodes coming out this season. We've got TiVo left to do. We've got the Nintendo Power Glove left to do. We've got Flappy Bird left to do. They're all very fun episodes. They're all coming out the next few weeks. Make sure you go subscribe to all those shows.

and subscribe to The Verge if you want to get them all ad-free. Until then, we're getting out of here. The Verge Cast is a Verge production and part of the Vox Media Podcast Network. The show is produced by Eric Gomez, Brandon Kiefer, and Travis Larchuk. I hope you have a wonderful holiday. We will see you very soon. Rock and roll.

This transcript was generated by Metacast using AI and may contain inaccuracies. Learn more about transcripts.
For the best experience, listen in Metacast app for iOS or Android