The thing I love about this job is you have to build with the paranoia assuming the server will arrive with no disks available to you. Like, you just you just have to, like, do all this loopy stuff, and it's really fun. It's actually just, like, really interesting to engineer at the extreme edge with those needs for paranoia. It's it's cool. It's really cool.
So how was the party? Was that yesterday?
No. It was the day before, but like an ad hoc party started yesterday again. The the we had guests who are still here at like 2AM in the morning after the party. It was ridic it was ridic like a DJ, we had like food trucks. It was like just so many people showed up. It was amazing. It was really really cool. I can't wait for you to come visit sometime. I know I know you know, you're too cool for San Francisco but come and do an addition of it. Just come work from the office, man.
Just kinda like come hang out. It's like the space for you whenever you wanna be here. It's gonna
No, I appreciate that. I I I mean, when I saw the yeah, saw you mention the party and I saw I didn't see too many pictures. I feel like I just saw like a handful and I was like, man, this is one I wish that I lived in SF. I mean, I I love it. I think it's like a beautiful city and I
Yeah.
And I absolutely like love being there but I just haven't been there in a while. But yeah, it's cool you can do this kind of thing.
Your company is gonna rip and when it does, you are gonna just have to come here a lot. Like it just becomes like it's the Hajj. That's why I love living here is because everyone comes and sees me, right?
Yeah. It's funny you say it's good being in SF because, you know, people are always there and you they kind of like, you just have someone in town visiting all the time. Yeah. That happens in Miami too except it's always someone here for their bachelor party.
It's like Yeah. Right.
The reason I see someone. Yeah. Yeah. Yeah. So my friends are in that group where they're like, the age range where they're just finishing that up. So I haven't I'm like seeing less and less people now.
Yeah.
Because they're not going on bachelor parties as much but yeah. So it's being in the city.
I hated that early thirties era where every weekend was like, my wife is in like a yeah. Like a bridal party or whatever and I just had to hang around at a hotel for hours just to go to a wedding with the people I don't know.
Yeah. Think escaped it for the most part.
But yeah. Baby shower's next.
Oh, yeah. Now we're we're definitely in that in that zone. But, you know, I don't know if this is the case everywhere, but at least in Miami and I guess in Latin culture, it's only a a woman thing. Like the men are not, but I've never been to a baby shower, period. So
I have, I think. Yeah. I think people just have any reason to like throw a party, I guess. And, you know, in white women culture, they like any reason to torture the men with you should care about these things as much as us. And so, we have to go and do those things. Because terror is the worst. It's the absolute worst.
It's like the opposite. Like we're think I'm like it's weird to like invite men, like, they're kinda like banned from the party. Yeah. It's just a woman thing. So As
as you know, half my family is Indian, which is like, why would we ask the men to like about raising the children? I mean, they have nothing to do with this. I mean, why? Yeah. That's It's great. We can build SaaS companies instead.
So speaking of how's it how's it feel? I know you guys have been working on Planned Scale Metal for a while, so it probably feels amazing just to have it out and you've been I can I can tell you've been having a you've been in a good mood this whole week?
Oh, it's been awesome. Actually, it's been really good. Yeah. You know when you kind of see a new world and very few people know about it?
Mhmm.
And you just feel this constant like tension. Like you're just so I know you're like this too, which is, you know, once you get this focus, you just wanna jump in and put everything into it and Yeah. Any anything that doesn't reflect that world is an annoyance. And Metal's been around for like quite a while now and and we launched it very very differently in the sense that we did our customers first and we were gonna like the secret, the behind the scenes is we were gonna be ready for re:Invent and we were gonna go and announce it in beta and make a splash at re:Invent. And we started showing it to our customers and they were like, well, can we move now?
And we were
like, I
mean, yeah, we can. We can move you. It's fine. It's durable. It's like, we test everything.
There's no, you know, there's no risk. It's just do you like, we would need to focus only on, you know, kind of helping you all, like, migrate and figure it out because you just don't wanna take any risk and do it properly. So we're we, you know, we'd need to do something differently. So if all of you are willing to be part of our launch, we'll delay this by a whole quarter. We'll get you up into prod and then you become the launch.
And everyone was like, sure, fine. I mean, some these are public companies, right? They had to get approvals everywhere to go and do this and it was the first time they'd ever done this stuff. And it was just an awesome way. Mean, was like very much in the style of what we wanna do, is push our companies forward like like we're we're just a database at the end of the day, you know.
It's only magical when they're up, right? And Mhmm. Doing and building their companies. And so, yeah. So it was a kind of tough three months to kind of just try and stay chill, know that we're gonna launch this thing and then watch our customers be successful.
But since launching, we've just had so many inbound like emails and people immediately just bringing us incredible expensive Aurora workloads and saying how much would this custom plans go? And it's so far every single one is gonna save money and get faster. So it's very exciting.
Yeah. It's it's funny to hear that because I so struggle to keep anything quiet. Like the moment Even before like the moment I have an idea, even before I've like actually built the thing, I'm like already wanting to talk about it. Whenever I see like, you know, bigger it's kind of bigger companies that like plan a lot more and like like announce things and it takes like months. I don't know how how I could I could ever do that. I just don't know how to discipline for it.
No. It's it's hard but it's great for what you guys do, right? Like you just kind of ship things and it's dynamic and it's what people love. I mean, a really good thing to be that way. If you you you kind of, I would I would say we we we still strike that balance of not trying to be too perfect, right?
You've got to hold on to that tension of of getting it out for people quickly. But at the end of the day, especially with what we do, no feature is worth production issues or reliability issues. Right. And so so we we just we have to be very cautious and and careful, you know.
Yeah. I know. That makes sense. The yeah. The charts I've been seeing have been really crazy. Just very dramatic dramatic drops in the p 99 charts.
It's so fun. Yeah. It's just like and then people are might like we're just watching people migrate and they just they're like messaging us their p nine nine graphs and being like, oh yeah, this is what happened. It's like, wow. I guess this is good.
I mean, is the theme. Who doesn't want that? I mean, we love as software engineers, we love that, right? We just love to either graphs going up or graphs going down dramatically normally means something good or terrible. But you know, in this sense, we're very happy. And the p 99 is the important one too.
Yeah. It's kinda nice in cases like this because I feel like a lot of time is wasted in software like debating things that are more abstract or like, we kind of over complicate some of these discussions and make it seem like really intricate. Yeah. But then in this situation, there's nothing to discuss, like number goes down. I guess it's really straightforward.
There's nothing to debate. Is this good? Is this bad? Like, know, none of the whole there's like no discussion around it because it's just like, you know, very straightforward. I think the things that are actually good tend to be kind of straightforward in that way.
A %. We're excited about it because it's that straightforward. It goes down to being kind of the formula for infrastructure startup success, is a kind of
Mhmm.
Whenever it's a huge shift in cost or performance, like that's what Snowflake did with ironically the opposite strategy, is by separating storage and compute
Right.
They changed that game fundamentally. We're going in the opposite direction technically, but but that is kind of how you win as you have this just big step change in one of those and then doing both is obviously very special. Because before Metal, although we were, as everyone knows, that we're running these giant workloads for like, I mean, like triple a games that, you know, we all play just run, you know, using this stuff. And it's amazing, but it is not like a the mass market that everyone can go and benefit from. Right?
Like like these Aurora has just Mhmm.
A
giant base of revenue across hundreds of thousands of customers and that kind of are pitched to a lot of Aurora customers. And if you read Intercom's blog, you know, it's it's very much describes it. And they and they did actually have an initial blog post a few months back about how they're moving off Aurora to PlanetScale to tell their customers that they're gonna be more reliable because Aurora is unreliable when it starts to grow. So our pitch was like, well, you know, if you're on Aurora and it's starting to become unreliable or it's, you know, you can migrate to us, we'll keep you scaling, we'll keep you at pretty much the same performance that you're used to infinite for infinity, like it just linearly will scale at that forever. Now with Meta, we're actually just saying, yeah, if you spend $800 to a thousand dollars a month or more on Aurora, yeah, you're probably gonna get faster and cheaper if you move.
That's huge. Now we just have to get out of our own way and make it even easier to go and do that and it's it's gonna be very good.
Yeah. So just to get into some of the details here, when you're deploying in AWS or any of the major clouds, you typically will use network storage. So this is if you spin up a server and you need storage, it's not attached to the server directly. It's on separate dedicated server server cluster that does does storage. So the trade off here is just performance because you're going over the network to access other storage.
The benefit is that storage can be made redundant, your server workload can move around, it's okay if they need to move it to another server or whatever. It's not attached to the physical disk on a server, can access remotely. So if you're building anything in the cloud that needs persistence because you need redundancy, you're pretty much forced into using EBS. And if you look at a lot of these like newer clouds that are like simpler, they tend not to have the EBS offering because building EBS is quite challenging. It's a lot harder to build that than to build like compute offering.
It's extremely hard to run stateful workloads because they'll just, you know, do the thing where they put your database and your storage on the same physical server. Sorry, your your your compute and storage on the same physical server. And then when that server like runs out of space, you know, do they do? Like they gotta like figure that out. If they need to move stuff around, now data is in one place and you compete somewhere else.
So it's very difficult to run persistent workloads in simplified clouds. But then if you do want to run persistent workload, historically, the problem has been well, you need redundancy so you have to deal with the EBS penalty. Mhmm. But what plan scale metal does is it keeps you in AWS, you can still, you know, use all the other stuff that that's there and if your compute's there, there's no latency penalty. But it does not use EBS.
It actually does use instant storage but retains the redundancy capabilities, retains ability to move compute around. And that's kind of the big innovation which as many database offerings as there are, there's not really one that retains all of this. So it's kind like the sweet spot for any serious workload.
100%. Yeah. That's I mean, perfectly put basically, you know, we when we were back in the data center days, your final kind of last resort for a serious issue was a RAID controller. Well, like at the end of the day, you know, we ran in the data center at GitHub, you know, and at the end of the day, if even if we were down for a full day because every replica exploded, like, and then, you know, we needed to get data back, we could at least have hands on machines moving disks and rebuilding RAID arrays to get the data back. It'd be horrible, wouldn't be, but it's that final piece of safety.
You don't get that in the cloud, like once you terminate an instance, an EC2 node with instance storage, it's gone forever, you'll never see it again. But with our redundancy model that's not a problem and the reason it's exciting for us is we're just buying the same machines Amazon does. Like they just take those exact same machines, they build all their software services on top of it. So if you're on Amazon buying convenience from Amazon, it's hard to beat them when it's at scale. It's about cost and efficiency.
But, you know, our software engineers have run bigger database workloads than Amazon themselves and some of the largest running on Amazon run on our software. Mhmm. And so it gives us the opportunity to just fully bet on ourselves. It's the same way that we increased our SLA. I don't know if you saw that because Yeah, did.
We don't rely on EBS. And and and and, you know, it's really flexible to use EBS. Like to, you know, we roll off our pods every twenty nine days. So every machine at Patsco is is less than a month old at any point. And EBS makes that really easy because you just detach the volume, spin up a new pod with the new version of MySQL, it attaches and runs and it's just easy.
That's the only trade off of moving to Metal is we do the traditional dance of like backup, restore. It's fine. We've done these, we've done this for millions and millions and millions of times. It's very, very robust, but it means that we yeah, we get that. And yeah, you're starting a database company today, you have to choose your pain and it's hard enough to do it one way, so you, you know, you usually end up people are doing it on s three as well.
Like there's companies like Turbo Puffer, shout out to Simon and crew, phenomenal. Like it's it's not an OLTP database, but it uses S3 to its advantage to provide like an incredibly cheap cost efficient way to do vector storage. Mhmm. It's not you only get a certain amount of your working set can be like hot basically and they then run that on fast local machines and then they back it all to s three. But running OLTP workloads on on slow storage is just lunacy.
Yeah. Yeah. And that's even crazier because there's like it's even more layers than than trade EBS. Yeah. There's not even like a trade file system.
Maybe we should talk about actually like because I'd love you know, your explanation will probably be way better than mine in terms of the impact of tail latencies, right? Like if we're doing, you know, 200 queries a page, right, which some people do, right, you know, that's not abnormal at all in a, you know, a large web app. One of them spiking up to five hundred milliseconds of p nine. That's a failed that's like a failed request worker part. Like, you've seen this stuff, like, you know, just Yeah.
It's that it's that band of consistent performance which is actually more important than than just an overall speed metric or average like milliset latency.
Anyone that's ever done any kind of performance work, you like the first thing you learn is like, oh yeah, I don't give a shit about averages at all. Because your averages always look great. They always look fantastic. Yeah. And then you look at your, you know, p nine nines and things at the edge and that's where all the problems are.
And when you fix things, that's where you see stuff react like like immediately. So yeah, I mean, stuff gets goes viral online where people just like, you know, do a couple calls and they're like, oh, here's the thing and it's it's funny. But when you're actually doing performance work, you know, it's it's all about the tail ones. And when you talk about like quality of a product, it's about feeling reliable and if p 99 sounds like, oh, that's like, you know, an edge case. Not really because like the it multiplies across number of queries and like as a user you like might hit that pretty frequently.
Yep. And like feeling like when you hit something and it's like four out of five times it reacts correctly, but then the fifth time it's a little worse. The users ends up feeling like the whole thing is unreliable because sometimes it just feels off. So yeah, that's where all the all the value is and that's where, you know, you have to focus.
You know, yeah, that's why your your normally your best customers are the ones that feel those the worst, right? Like it's they're the ones with the most data, ones with the kind of I remember Bootstrap, Twitter Bootstrap was by far the largest repo on GitHub for a long time and it just Mhmm. Someone browsing through the stars page of that with a script would just take the website down because it would just be pulling all of the data off of disk and whatever, you know. Yeah, it is so important. And that, you know, people, you know, they think, well, you know, you're just putting the network over you know, network store attached storage.
You know, we've done this forever, SANs or whatever. I get it. I understand, but doing every IO, which databases are incredibly chatty, it's not just your queries. The databases are doing other things like checkpointing and checksums and replication and managing a buffer pool. Like they're doing so much reading and writing to disk on your behalf to maintain all of the other things that databases have to maintain.
They're incredibly chatty and to do all of that over the network is just unbelievably costly and you see this in the graphs. And you're not just like just going over a network, you're going to three machines for redundancy, you're going through a type of load balancer. If you hit one node that's doing some kind of rebalancing or traffic shaping, that's gonna slow you down. Mhmm. We we've seen outages and we're gonna do a blog post about the kind of true reliability b b b s.
We we've seen outages where Amazon were like, yeah, maybe that was just like a blip. And we were it was more than a blip across multiple accounts. Mhmm. We we've we deploy so many EBS volumes, like, such a massive amount that we saw we noticed they had like a top of rack switch issue for one of the the EBS racks. Wow.
We saw it across multiple accounts. They first talked to one customer, they denied it was a problem and were like, well, three other customers of ours saw the exact same thing. So you clearly had a like a service issue and they're like, oh, yeah, you're right. Like we did actually. And and all of those things can just happen.
And now now you think about it, to put that in between just getting a page of data off of your disk, it's mad. It's actually great. Like Yeah. The cloud the cloud is is if that's the only cloud approach, luckily, it's not, then it's fundamentally wrong for databases. Like, fun fundamentally, they're they're not gonna work.
Yeah. It's funny you mentioned the when you have visibility into stuff, you do pick up on these things. We had a similar case where just because we see a lot of AWS customers as well. We saw that a subset of our customers had problems with they they were into this bug with Lambda, like they would invoke Lambda and like the response wouldn't be correct. But it wasn't just one region, it was like a subset within the region.
Mhmm. And it was really hard to track down because we're like, what is going on? Like, we can't replicate this. And it turned out they had like rolled something out to just one like a physical building before the other the physical partition before the rest of the region. And like, found the bug before like they Yeah. They realized it.
It's rough.
But it's funny you pick up on on some of these things. And prior to that, we also found out like a lambda function feature just was not working at all like globally. And you think someone like AWS like literally a million customers, you would never be the first one to run into an issue. But yeah, there are there are cases where
It happens.
Where that happens. Yeah.
Well, they're they're now a big engineering org. Mhmm. Like, they've built awesome stuff, but when you have 400 services
Mhmm.
It's like really hard. It's really hard. Of course. It's like innovator's dilemma, purely very simple, like how do you just address all these things at once? It's not it's not easy.
It's really really not easy. But luckily we're now in this amazing era of lots of startups inside that ecosystem having a fairly constrained place to be. Mhmm. There's like a debate on Twitter about this last night. People were talking about, you know, the difference being that we're inside Amazon with this tech because you could go and get like you could like you said, you can just go and get these machines from like Equinix or whoever and build on them, but that's not the point.
You have to be next to Lambda, you have to be next to s three, yet where everyone's traffic is. We just don't see You can't run serious services outside of Amazon. It just doesn't work. And then Google second and, you know, there's just everyone is there and they're using everything else. If you're not inside, if you're like not a v you know, a paired VPC away and you're it's just way way too slow. Way way way way way too slow.
Yeah. I was actually gonna bring up next because a lot of so there's like the pure technical side of what you guys built, but there's also a bunch of constraints that aren't like really technical constraints. It's just the realities of constraining yourself to do this in Amazon. Because obviously, you can go and that some companies that have done this buy hardware somewhere else. It's probably a lot cheaper, so like all your economics are probably different.
And you can like build something very performant outside of Amazon. But to do it in Amazon is the trick and it's funny because it's not like real technical some of them are technical limitations, but a lot of them are just working within what's possible with what AWS offers. Just like, you know, you can't just say, I want a server with this size disk. There's like limits on how much the disk size can be, like how does that correlate to CPU size, memory size, so that probably impacts prod decisions on your end. So it's funny because to me, this is like I it's obviously the case.
Like you have to do that because your customers workloads are in AWS, so you have to be in AWS. That's just non negotiable. Mhmm. Very easy to build a great product outside of that. So I think a lot people show off great products that are not in AWS.
I don't find that super impressive because like that's not the hard part. Like, you can't actually build a big business that way. At the same time, I'm just like, man, this is a crazy it's like way too sticky for AWS. I'm like, how do you ever compete in certain categories with them when like you just have to be in there, you know, like, it's just like a ridiculous monopoly, feel like.
Yeah. It's it's like waking up and saying, gonna do a telecoms provider or something, right? Like it's just
Yeah.
It's so difficult. It's a giant operations game now and there's like clear winners. And all the other ones that are now taking parts of Amazon's customer base are similarly just massive businesses that can light money on fire for a long, long period of time to go and grind out doing it. Yeah, it's really hard. I mean, until you've spent significant amounts of time using Amazon's VPC Reachability Analyzer, you're not there yet.
You've like that, once you're in that hell, you know you're like trying to build things of significance. And yeah, like, you're just completely right. It has to be inside where those workloads are. And the constraints are crazy. Yeah.
Mean, it's all of these little things, all of the little networking bits. The fact that one physical availability zone is not the same for everyone's account. People don't realize that, you know. So you end up getting strung up and stuck in all of these different places. It's it's it's complicated. It's extremely extremely complicated.
Yeah. It's funny like when you're working on this stuff, you just see underneath the abstraction where like, it just feels like for most people it feels like it was just like one big computer that you just Mhmm. Put stuff on. But then when you work on this stuff more directly, it just that fades away and you're back to buildings and like physical racks and and and all those problems.
We give them hell obviously like everyone does. They're kind of our competition but they're also our partners And they are amazing with us in terms of their openness, you know, that we like, when we get on a call with the engineering team, they they are customer obsessed. They truly are. You've seen this too. Right?
Like Mhmm. Their engineers are curious. They will get on and they love that you find these problems. You know, we're having fun with the EC two team because now they're like, yes, more giant databases to run on our stuff directly. That's cool.
You know, it's really fun. But yeah, like you like you actually said, like, you know, the long tail of shipping metal was, okay, do the really hard bit, which is how do you run petabytes of data reliably without losing data on machines that can just explode and disappear? The long tail is making that really reliable and all of the rough edges is gone. So for example, you know, EBS the great thing about EBS is you can take like a pico node, like a quarter of a vCPU and attach an 80 terabyte volume to it. You couldn't do anything obviously with it, it's that flexible.
That's one amazing thing about it. We don't need that for LTP, but, you know, we need people to upsize. Right? Where people actually have to like say they want to make their machines bigger. So we have to we've we have stuff that nags you.
You're 80% of your storage and Yeah. You can just like we'll we'll make it so you can just turn this on and it will scale out automatically, but not everyone wants that, right? It's like people don't auto scaling is that's another giant myth that, you know, that we could we could go hours into the auto scale. Like it works for certain things, for other things it's an absolute disaster and most people when you actually ask them what they're asking for, it's not it's not really how auto scaling works or is implemented. But anyway, so we have to and there's things like, okay, you're going do a schema change.
Well, if you actually apply this schema change, it's going to fill up that box. So we have to kind of warn you that you would need to upgrade before you go and do it's all those kind of just little UX pieces that make it approachable and usable that takes the time in terms of building these kind of products out. And it you're yeah, you're dealing with weird there's there's this kind of when you look at these nodes, the SKUs are really all over the place. You wonder like, which custom customer did you add this custom machine type for? Because like, for $10 more, we can have double the memory.
You know, things like this.
Yeah. Exactly. Yeah. Compute. Yeah. It's it's like it's so much of the work is just not the programming part. It's like just looking at the numbers and like understanding all the economics of this stuff and
Yeah.
The way that they correlate, like they attach because you're using instant storage, but you can't say I want FireRig use instant storage. You pick an instance that has some kind of CPU and RAM combination and it comes with some fixed amount of storage. And like to me, those numbers are just so random. It's like
They are.
Why I want a lot of storage but I don't need like 64 cores, so
Yes.
Yeah. And it's a funny problem.
It is funny. And so, yeah, those are the kind of things where we've had to kind of figure it out and and kind of work out the skew, like the skew just the word skew is like a meme here now because the like the kind of just dealing with all of these various things. We also had a really fun issue with these nodes, which was they fail too and they have issues and they can come up with unmounted disks.
Mhmm.
And so they we had an issue where they were just coming they they were coming up and not being fit to serve. So we've had to build something where Amazon will give us a machine that's not not good. What we would do is like, we'd throw it back. We'd just go Mhmm. Nope, get us another one.
And we'd get the same machine back sometimes. It's like, that's still not still broken. So now, we've got this logic where and we've seen it chain like two or three in a row. If you give us one that doesn't work, we hold it until we get given another one.
Oh, I see.
So we have this kind of pooling logic where we will just keep the nodes until we have no more node demand, and then we'll let you have let let Amazon have all the bad ones back to give to everyone else. And you're just like finding this stuff out while Yeah. You know, running it live. And, you know, with the amount of machines we've deployed, that, you know, one in a million failures happen a lot. And you get to find all these little edge cases and weirdnesses, and people don't build with you.
Like, the the thing I love about this job is you have to build with the paranoia assuming the server will arrive with no disks available to you. Like, you just you just have to, like, do all this loopy stuff and it's really fun. It's actually just like really interesting to kind of how to engineer at the like the extreme edge with those kind of needs for paranoia. It's it's cool. It's really cool.
Yeah. It's really fascinating to me because I know like where my skill set is. Delivering a reliable service is just not just aligned with where like my abilities are. Like I I just do it I just don't have a discipline for that. I'm just way too I don't It's just not this hasn't been my trajectory.
So hearing this stuff is interesting and to me, I'm just like how do you even go about this? Like you build something and you think it works, but how do you know that like some random undiscovered thing isn't gonna happen
Yep.
You know, a month from now?
Yeah. And you have to you have to decide on an architecture that you believe in and then very simple ways to fail that don't rely on people. You know, I and by the way, a lot of database companies, you they don't have the skill set of running services. They can do the database engine stuff, which is incredibly hard and takes like a certain type of cracked person. You need the the other type of cracked person, which is runs can run huge services at scale.
Most companies don't have the two. That's the one thing that's very different about PlanetScale is we have both. We have people that run mega websites and the deep kind of database core fundamentals of, you know, parses and query planners and all of storage engines and all that stuff. One philosophy that we have, which I think is kind of really amazing, and it's because of a shared nothing architecture. We talk about shared nothing a lot more in the future because it's an architecture that people don't really understand.
It doesn't come up much, and it's really truly the ideal end state for building these kind of systems at scale. But essentially, you know, you can't build a reliable service unless it doesn't rely humans to wake up. Because if you pay someone at 2AM in the morning, it's minimum of fifteen minutes. Well, that's your SLA just exploded anyway. Right?
You know? Mhmm. It's gone. And even if they do have to intervene, what options can you really give them when they have to come up to speed and figure out? So essentially at PanScale, all of our architecture is designed to kind of just have one solution to everything, just kill nodes. Kill the primary node
I that shard.
Just kill it. Just get rid of it. Like, it's the 99.9% fix for everything of like why cat or not pets or whatever, like, why it's it's not kind of trying to understand this node's feelings. Just shoot it. Never and never think about it again.
And that's literally it. Like, and and Vitesse just has handled failure this way hundreds of millions of times. It just knows, okay, that node is gone. How do I get the cluster back online and quick quickly into a kind of healthy state? It just runs that same, like, well worn code path to go and do that.
Yeah. And it makes building things reliably a lot easier. It's hard to do that but it's but the mental model is one thing. Get like kill the kill the failing node. And every time we've never touch wood, we've never caused global outage for any customer.
The worst you can have is like a minute of a shard being unavailable, which is partial failure, it's fine. No no one the other reason people build unreliable services is because they strive for like perfect records, no bugs. Like that's crazy. Like you have to embrace failure because it will definitely happen. Yeah.
But yeah, the resolve is always just kind of you you murder the node and bring it back and it becomes partial and and it makes the mental model so much easier. And it goes back to again separating storage and compute. Because of the shared nothing architecture, our nodes have their own truly like I guess full stack if you think about it. They have their own disk, they have their own memory, CPU, own copy of the data replicated from elsewhere. They they they share nothing with the others.
These kind of shared storage layer compute stuff like Aurora and whatever, they share way more. So like a single out like a single outage at any one of those layers of the stack is a is a full and total outage. Yeah. Exactly.
Yeah. It's funny how good that solution of just restarting, like killing and restarting is. I was mentioned on Twitter a couple weeks ago. I've been moving a workload from Lambda to a container and I'm just discovering like so many bugs that I just never bothered handling because my with Lambda, it's effectively rebooting like every fifteen minutes or so. And now that I have this long running service, I'm just like, oh, great.
I like didn't dispose of these things in like a hundred different places and I gotta go go chase it down. And yeah, on one hand, I probably should have just had better discipline about it. I mean, any discipline I had around has deteriorated ever since I moved to doing stuff on Lambda. But like, you know, it works. Like it works really effectively.
Who cares? It works. Git GitHub and so many other companies back in the other days, we used to over Christmas, we would always have some outage due to a memory leak because we'd stopped we'd stopped deploying the website. And so the the Yeah. Yeah.
The kind of versions of the app were just living for like weeks longer and we're just there was memory leaks everywhere. Like just frequent deploys kind of covers up some of these things. It's fine. Like, that that who gives a shit? Like, it's gonna fail.
It's, like, definitely gonna fail. Like like, embrace that. Just know it will and do the right thing. I I was gonna talk about this, you know, blog post about magic, cause I think we all we all wanna build things that are kind of fun and delightful and everyone likes the shiny web pages and whatever. But at the end of the day, you know, the magical experiences of the, you know, getting home to your family safely at Christmas, right, on an airplane.
And and it's it's more like building an airline than it is anything else, you know. All day long while we're talking just up and down up and down seven thirty sevens or whatever going up into the air coming down, they can be repaired at any airport on earth by a a crew of people on a shift that are just managed like through engineering firms or or whatever. They fail in the most predictable ways. The most regular failing parts are cached at every airport in the country. Like, how many times do you just get that kind of half an hour twenty minute delay while they fix something up and just get you going?
And you're you're not unsettling, you're safe, you're gonna be okay. Like those planes don't even turn off. Like the like a seven thirty seven will land and will just like sit there on, go back in the air. They'll do 10 flights a day. It's just so reliable.
People need to think of themselves as building that and how that works. Like how the food gets on, how the food comes up. Like that that is the real process of building this stuff. Not let's just hope it doesn't fail and make it really pretty. You know, it's just not gonna it's not gonna cut it.
Yeah. Yeah. No. I think I think in a lot of parts in life, it's making things invisible is a is the value and it's Yeah. It's so hard just to have something that's there that people aren't thinking about. Whether it's tech or like just anything in society in general, I feel like people really accomplish something when they solve the problem totally invisibly and no one ever thinks about it.
It's beautiful. It's beautiful. It's really beautiful.
So moving away from the technical stuff, so it's been a year, I think you said, since you guys had like a big shift a year ago from being I don't know. Maybe you maybe you just wanna describe it yourself.
Around a year ago, I think the anniversary was last week, we we let go a big chunk of the company and doubled down on being pretty much purely an engineering company. Mhmm. It was a reaction to multiple things. We were kind of in we were playing in the in multiple ends of the database market, we felt this, like, real strong pull at the top end of the database market. And the bottom end was just a painful mess basically of cloud spend and people that don't have real problems.
And and the thing about like kind of the tech discourse of Hacker News and Twitter is you've quickly realized, I know you know this, which is most people don't have real problems. Like that's just truthfully, like, sure, fucking put SQLite on a server, like who cares? Like your two users won't notice. Like it just doesn't Like you can argue with people about Postgres or whatever and you just realize they just don't if they they just don't see the world the way you see the world. Right?
Like they just they they whatever they choose, it's gonna work and it has and it's their lived experience and they feel great about it and they don't pick technologies for the traits that we pick technologies and that's fine. It's completely there's no hate there. But when you're trying to kind of be in that area of the market and you're spending so much money on having like a free tier that will just not convert, you have to have marketing people that do that kind of media that works for that and it's just expensive and it's not optimized. And, you know, we saw a path to being a profitable company, which one is just incredibly powerful. Like we threw this huge party at the office and, you know, we have a lovely office now and we, you know, pay the mortgages of all of our staff and it's like our money.
It's in it just goes into the bank. We're not just, you know, hope hype round, VC hype rounds, hopes and dreams just spraying money up the wall while we just every customer costs like if a customer costs you more money, you're just reducing your burn constantly and we're now the opposite. If you write, if you're a $39 a month customer with us, you get like, you have a problem, you get a thoughtful reply from our amazing support team because you are a customer. We make money from you, it's amazing. We had an opportunity to do that, so we did it.
It was really painful, you know, I definitely would have done things slightly differently. But in the long run, it was an incredibly powerful change for the company because it focused us and gave us the autonomy to do things. Like this launch, the way we did it, we we just Mhmm. If you were, you know, a VC backed company with eighteen months of runway, you would just go to reinvent with your beta product just so you had that you had to build pipe. Just just more pipeline.
More pipeline. Like, you have to just go and ape it out there and shout about it out of desperation because you don't have long enough left. We were like, oh wow. Yeah. Actually, just launching it with some of the major biggest like tech brands around already running on it on their blogs, that's an obviously better launch.
Well, we're not going out of business so we can just do that. Yeah. Do you realize like when your daily decisions are made from a place of strength and not fear, how that compounds? Like it just we make decisions every single day that you can only make when you're profitable. Like and so, although, again, I miss the people that aren't here, like there's some amazing people that don't work at Pantscale anymore.
It was like the best thing we could do and it gave us this year to go and build metal. Mhmm. And it's we've done it and it's it's, you know, it's already just changing the company, like immediately. It it was the right thing to do. And it was it was just a very different thing than we are used to in tech.
And when you're building a deep infrastructure startup, you just need time, like, it's just time. Just like, you know, we've got a customer, I think, pays a couple of million a year, I think, now. I first showed them the product in beta, like, was barely real. And they're like, cool, this is great. Four years later, they eventually became a customer.
Yeah. Because they they they're just they're just not gonna Yeah. No one there's no offering just like, yeah, we just yeeted our data over to a startup. Now the business is finished but like, you know, like it's like they had cool features, you know, the website was shiny, just doesn't work. It just like our sales stance is so funny, know, we're we're working with at the moment this really very large public company, very famous.
And I was talking to the CTO and it was, you know, me and one of our sales engineers and he was like Google sent 18 people to try and to try and sell a spanner and you're here on your own. And I said, well, I mean, let's be honest, like, you and I never said the name of the company. Is anything other than like a technical proof of concept where we prove to you we can do this gonna convince you? Like, do you need slides and an interpretive dance done in front of you? Like, you just need to know we can do it and you have your own requirements unless you see it for yourself, you're not gonna buy it.
That's us now. We fully embrace that which is look at the website, it's just we just tell you what we do. We don't wanna hype it up. It's like if you have problems that fit our solution and you're serious about those, you just will read it and try it and it'll work. We kind of opted out of all that other crazy stuff.
Yeah. That's that's super interesting. I mean, I wanted to ask you there but on that last thing, do you ever and maybe this happens less now, but the thing you mentioned was you guys did things differently. There's because yeah, there's a there's a standard playbook, right, with certain things, right? Like you said, a bunch of companies building products for developers do this standard playbook of like investing a ton of marketing on like the lower end.
And all these orgs look exactly the same. They're all producing the exact same stuff. But then also on the enterprise side, the way you build organizations that sell to enterprises, also like a standard playbook there. Did you Like, do you have people telling you to like, or pushing to like follow those standard things and like, what does that look like and, you know, like, it annoying?
Yeah. I mean, you do get it. People do question it, they wonder and I just like don't care what anyone else says. The end
of the
day, I spend my life on this thing. Right? I'm only gonna do it my way. That's it. Like at the end of the day, if we fail, the person like turning the lights off at the office for the last time is me. Mhmm.
And
so I'm only gonna do it the way that makes sense to me. And I'm like an odd a weird person. I figured that out right now. Like I'm just very weird. I mean, I just have my things I wanna do and they either work or they don't. But I can't be anyone but me. And I can't I'm not gonna get like a 42 long blazer and go and kind of put a briefcase and do like
Well, they tell you to hire someone that does that. Right? That's kind of what the standard playbook is.
Like, oh,
you gotta hire this guy, he was, you know, CRO at this company and, know, he did he took them from x to x. You have to hire him, put him on your team and like, so he can run that same playbook again. Yeah. And that's usually how I see it. It's like, the investors or whatever will suggest a hire and that kind of fundamentally changes what the company is and that's why they kind of all end up looking
Mhmm.
Kind of the same.
Yeah. And and and very few of those people have ever sold databases or really tough technical Right. Deep technical stuff. There's some types of product where only the go to market function is what will work.
Right.
Yeah. The tech the technical moat can like, the technical standard can be achieved for that those types of products very quickly. Why is Ramp bigger than any of the others that started? Like, why? They just they're a credit card issuer. Right? Like, they, you know, why?
It's so funny you bring up Ramp because I have a friend that just gets free lunches from them all the time and just never because they're they're just always hitting them up. Like, every month, they're like, let me take you out to lunch. Let me take you out to lunch, you know. He just does it. He just never intends to be a customer.
But they're a go to market machine. Like, look
at Yeah.
Exactly. Amazing companies like Rippling. Right? Mhmm. Which is like, they have some, like, hard tech problems now because they're scaling. But at the very beginning, it was just a phenomenal brute force product team that would just like understand everything a customer wants, build it, ship it, make it happen. You need you would need these types of people to build those types of companies. Yeah. Databases just like don't work that way. They just can't work that way.
Like our core audience are, like, back end engineers with hard problems. It just it just doesn't work. And, you know, we'll we'll we will build out the sales team. We will build these things out, and we have to build like, Mongo has one of the best sales team ever built in tech, like legendary. They wrote the book. Mhmm. They still needed to do that to build a big database business. You you have to. Mhmm. But the the the marketing paradigms shift over time.
Mhmm. And what worked ten year like, it's always that classic of like, yeah, like this person's there, you know, and they were at Twilio and they did this thing. Twilio nailed developer marketing for that generation. The Ask Your Developer billboard is legendary. They crushed it. We've moved on. We've gone past it. Like, we're elsewhere now. Yeah. And I think now it's gonna go back to simplicity and value, like and and we're we're seeing that.
Right now, I love AI. I'm not cynical about AI at all. I love it. But, you know, there's a lot of AI slop content being made Mhmm. And it's just like rubbish.
So we're we're now doing spending a month per blog post to make and we got one going out while we're talking right now, like, quality, really good stuff. You just it's what it takes now to cut above. Like, you've seen you've been to reinvent. You've seen the hundreds of millions of dollars of marketing spend just being screeched to each other. You just have to do something to cut through.
And and and that's why we do it our way. And if you have taste, it is such a moat. Like like our website started in a Google Doc. We just designed it in a in a in a g a Google Doc with words. Holly did a thread about this last week talking all about it.
And people well, some people were like, my god, this is genius when we shipped it. Other people were just so confused. They were like, this this company's gone nuts. They're gonna go crazy. I don't know why when I said we we were gonna do this, everyone at the company was like, yeah, let's do that. That seems like a good idea. I don't know why. That's just taste. You know know what I'm saying? Like when you saw it, you were like, oh, love this.
I don't know why you love this. I don't know. It's like the first thing I thought of. I I I I don't understand why I like it and other people do and some people hate it. I just don't get it.
But if you do have that, knows. And and we've had it with other things like the other like database branching, we invented that, all of these different things. If you have that, use it. Don't you just see so many companies go wrong by having all of this taste, this initial thing that made them then them, and they're like, okay, so we've got this unique thing that's growing, we've got this advantage, this view completely unique viewpoint on the world. So let's go and do what, like, every other company does now.
Like, let's just like throw all that away. And VCs are some some of the worst for this. They're like, are we back contrarians and we want the and then the and then and then I you know, my friends, the companies, they'll phone me and be like, yes, my board is telling us like, it's now enterprise sales, go to market demand gen and and way too early and it's just like pattern matching and running the playbook. It just Yeah. No great company was built that way.
Yeah. It's the thing you talk about where there's a time where things work and it doesn't work anymore. I think that's like marketing for sure but across business in general, I think people look at great companies and they like try to copy the surface thing there. But the thing that people forget is when those companies were founded, they didn't look like anything like the great companies of their time. They did the opposite.
So if you're doing that today, innately you're not doing what they did. And the marketing thing is funny because the only thing that matters in marketing is that people want to hear what you're saying and it's so much like fashion and that some approach to that will be novel for a while. But it so quickly becomes like a counter signal almost like like the whole mean, talking about landing pages like, you know, linear did their crazy landing page. And for a while that was like really great. But now when I see one of those, I get like a negative reaction.
Because somewhere in the back of my head, I'm just like, I know they hired like some standard design agency. They like threw them 200 k and they didn't like think at all. We're just like, I want a clone of this. And without me constantly thinking that stuff, I just equate it with low quality. So yeah, it's like fashion and it's not irrational, like the whole point is novelty and like, you know, standing out.
And especially and even at your guys' stage, like, you got to figure out how to make your dollars go further than than they should. Yes. If you are buying attention for a hundred k, a company with 10 x the money as you will just do that at 10 x.
So Yes.
Yeah. That's the thing with marketing where I'm like, I don't know why people don't see that. And the flip side is, it's actually really fun when you set the constraint of we need to do stuff that nobody else has done before. Like we need to do things that are like so different from everybody else. We need to do things where when people see it, they're gonna like grab it and like share it with their friends at work, right?
If you set that constraint, it's really hard because like, you know, 99% ideas don't pass that bar. But it's so fun because that's like such a pure creative exercise that I feel like most people should love. And so exciting when you like stumble on something and and you're hyped to get it out.
It's kind of scary as well because you have to just you spend half the time being, you know, it's so funny, you're like, why is no one else doing is this so am I just so dumb? Or am I like just not getting this? You know? And then you do it and then, you know, it works. You're like, oh, maybe I should try another thing. You know? Yeah. Just like
Yeah. Exactly.
We always joke we're a tiny marketing team, but we always joke like the biggest challenge is that we'll try anything. I'll try anything once. So I just like Exactly. Like I'll just do anything. So that's more open ended and scary than anything because it, you know, you just have to go and do that now. Like, what can like, what's the highest agency thing you can go and do? Mhmm. And just do it. Don't pattern match. Don't listen.
Don't care. We're the only people not building a separated storage and compute architecture. Like we're the only people not building it for years and the VCs would just go, oh, mean, Snowflake? It worked for
Snowflake. Alright.
You know, they're just like pattern matching, I'm just like databases don't work that way. And they just look at you like, oh, yeah, you're one of those. You're just And then, you do this stuff and but we spent four years being told, like, you know, there's another well known storage, separate storage computer database company and they kind of came onto the market with like loads of hype and and, you know, someone messaged me. I was like, oh, you know, what you know, what do you think about this? And I said, you could give me a magic wand right now and to wave that would immediately instantly switch PlanetScale to that architecture right now and I would throw it in the trash.
It is would never do this. I would never and they look at you like, wow, that just you just sound better. And they're like, I'm sure I did to them, but like, where are we now? You know, like like you just you just like you just have to you just have to feel insane for years and years and years on end and just prove it out. I also think, by the way, when it comes to this marketing stuff, generationally, we're in a different world, thanks to kind of the Rails community, thanks to the Node community.
You know, I'm old now. I'm 38 years old. When I was a git, I was 32. Had a hundred million dollar budget for data centers and software and whatever. I grew up in the Ruby world. Like, the tools I used were beautiful and good, right? Like, you know, the 2013 kind of tech era when I was an engineer, you were using Heroku, you were using Rails, you were using all of these really well crafted GitHub. I mean Mhmm. The one, right? Like, these well crafted beautiful tools.
Like, did GitHub do different to SourceFlash? I mean, nothing. It's like, except be usable and resonate to a generation. All those people who grew up on that software are now VPs at big companies and don't want to buy crappy shitty software and and don't care about the hype.
Yeah. Exactly.
Like they just they just don't care. They just it means nothing to them. It just it just it's just like the sad thing about AI, and I love AI and like an o one pro subscriber, I love that thing. Like, you know, it's it's amazing. The thing that ruins AI every time is the gap between the hype and the reality because the reality is good. The reality is actually amazing. Mhmm. Paired with the hype, it's ruined. I can't watch movies. Just don't watch movies.
I I I people laugh, joke at me all the time. I saw The Matrix the first time ever last year. Thought it I thought it was terrible. I don't know what anyone was like. But anyway but like, the I can't because the hype kills it for me.
Like, it just you just it's everywhere, and then it just cannot possibly be as good as everyone is saying, and it ruins it. And the times where I kind of just nakedly use AI for the things it's good at, it's just unbelievably magical. The day I wake up wishing that my Siri would like rearrange my life and do everything for me, I'm very disappointed. And Yeah. And I think we're at the begin and I hope PlanetScale kind of shows that we're putting skin in the game is that I think we're in the post hype era.
I think everyone's dopamine receptors have been worn down to just a nub and I just think someone wants something that's good. And and there's a pull request of 64 versions of my launch post for metal because I I wanted it to have as few words as was like, you know, like you it was like coding golf or whatever, you're just trying to get right. It was just like well, I sent it to one of my dearest friends in the world, Ted Nyman. Shout out to Ted, he's got an amazing company called Case that he's building. An incredible writer, just kept sending it to him, and like, I just couldn't get it where I wanted it to be, because I just wanted it to be I wanted it to convey what's special, because you only get this tiny amount of airtime, but I didn't want to indulge in anything other than here's a customer.
Don't like, what's the news flash for most companies? Companies says, own product is amazing. Okay. Good. Good job, you guys. You know, confidence is important. But I just wanted to be like, don't ask us. Who gives a shit? Like, it's a database. Like, go to Cash App, the you know, go and look at their public filings of that company.
Like, the things we know about how incredible that company is, you know. It's in, like, Kendrick Lamar songs and Super Bowl ads and, you know, that's the cool bit. That's the actual cool bit, right? And not not the the kind of, you know, semi sync replication. And so that's why and I and I think now, I think so I hope we're at the beginning of this post hype era of what you what's your what are you actually doing?
And then I think it becomes the, you know, the billboard ads shot on iPhone? They're the most self aware amazing ads. You look at Google ad for a Pixel and it's like eight mega like, how many megapixels are we at? I don't know how many megapixels the iPhone camera is. I buy the new iPhone every single year, but it doesn't matter.
They they are so self aware. Like like Google just give you a lot of tech specs. Of course, do. It's Google. Apple just say, here's a picture of a yurt that someone took.
Like, that person is exploring the world and is cool and we're getting out of the way so they can do it, shot on iPhone. It's that awareness, I think, and I think that's hopefully where we're getting in tech, which is we've gone through this massive amount of hype and physics have not changed. The rules of software have barely changed. Present them simply, spend your time building something good and people will like it or they won't like it. That's all it matters.
Yeah. I mean, I I hope you're right because the thing that is tough is especially with like when you're early in a space or trying to figure something out where things are going like, you know, AI for example. The problem with that approach is it just creates so much noise and to like have any kind of clarity is so much where like so much of my time is just spent like thinking so hard about these things and like trying to filter out like what is definitely just some person's personal insecurity manifesting as like some serious seeming opinion on something versus like, you know, what's actually real. It is just really tiring. And I was thinking about this this today, you know, with all this, again, I'm very pro AI just like you are.
I try to use it as much as possible. I'm not one of these people that are like, you know, against it. But there's so much talk about I just built like the craziest thing without, you know, any effort whatever. And there's like so there's so much discussion around this. And I keep thinking about the products I use and I'm like, I use like five products and I haven't used a new one in like a long time.
If there's all this stuff being built, how come one of you has not built something that I like love, right? It's it's like not showing up in the place that matters. And I I felt this way about tech for a while where I feel like we're just obsessed with these demos, like here's a little demo of something. Whereas, I think kind like what you guys do with this launch, it's like, oh, we this thing has been in production. Look at this thing we've actually built, now we're gonna talk about it.
That's so much better, I think, outside of it being just better for people like, you know, it it has more value. It's just a much better filter for yourself. Like if you're trying to like show something to the world, like just wait till you actually build something cool with it because that'll just kind of filter out a bunch of things that you're just gonna waste your waste your time on. So we definitely try to make sure, like I said, you being even though I said that I get really excited to to show stuff off, I make sure that I like put it into production, use it for something real and know that's actually useful before before I talk about it. But again, like it's just it's just not it.
Like every single company in DevTools whatever, they just put together like a stupid demo of a product that no one's gonna use to show off some feature they kind of made up.
I think what's key that you understand because because I think people could misinterpret what you said of conflating shipping slowly
Mhmm.
With, like, take being deliberate and getting it right. You can iterate. You just you just have to, like, one of my favorite engineers at the company is a guy called Mike Kudomache. Mike just spends his day talking people out of scope. He's like, well, actually, why don't we just do less?
Like, why don't we just like what's the kind of minimum thing that proves it out? And there's a great you can whoever's listening, you can Google this. Spotify had a slide in a talk years ago that was like iteration and it was like, you know, job is like get to the shops or whatever. Sad person waiting for a car to get built versus skateboard, scooter Yeah. Bike.
Like, it just gets Yeah. Better daily and you can still go back and forth. Like, yeah, for a while, you're trying to skateboard with shopping bags, can't imagine how that's like, but, you know, but it'd be at least you're you're doing something. There's there's this minimum functionality. You can ship stuff daily that is consequential towards something big.
If you're very clever and selective about how you iterate and and build and kind of your tooling backs the ability to do it. And and I think people think, well, it's either like waterfall ship every six months this perfect thing or ship garbage and hype it up every day. And it's it's it's neither actually. It's this kind of middle ground of like pace and learning and sensibly defining incremental progress on you know, like the eye, the evolution of the eye, right? Like an eye did not appear, but some light sensing kind of, you know Yeah.
Was so useful on day one. Yeah.
Exactly. Just sensing shadows or whatever when no one else, no other thing could. I mean, so so much, so powerful. Yeah. And, yeah, like we don't have point of time recovery for like externally for users yet. Right? Like you we can do it for you, but you know, it's just not wrapped up well. We know we need to ship that. We just our big customers don't need it. It's not something that people do at massive scale.
You know, mid market people want it. We know we don't have it. Right? So like could it delay metal or just ship metal and now work on that next and you just go through it and you just kind of grind it out and you make it happen. I will say one more thing about hype though, like I am in your audience.
Like I think in the world of AI, trust and credibility is gonna be essential. That I sent I guess like why we blog the way we do, is like we wanna like educate people and really speak from a place of authority. Like when you say you like something, trust it, right? Because you are selective and and because you say you don't like things and you don't just kind of hype it up and that means I'm an actual member of like your audience. I wanna hear what you are thinking about and and because of that credibility and and trust and that and and people ruin it so quickly by hyping up.
There's other YouTubers that I know are very good engineers. I know they are. But for for money, they lie about the technologies they use. Like bad. That is bad.
We are in that era of tech now where the grift is on and that they know better. They literally know better in an exchange for money. And I mean, it's the same with what we watch for crypto, like all of the VCs that quietly shuffled off their kind of Right. NFT profile pictures and they're now hyping up AI. It's like, you can't trust these people.
They just believe in everything. That selectivity and taste and building your audience on truth, don't I don't really have much of a following on Twitter or whatever. Because I like I just tweet what is actually true about databases. Tiny Tam of people that give a shit about that, but like, I mean, who cares? Like why why change?
Why risk it? So I think it's like holding on to being genuine. And I there's very few tech media. Like I told you, I listen to this podcast every week because it's like a real thing and it it just feels like we're in this desert of of genuine good content about tech and hopefully that will change as as time goes on and we all grow.
Yeah. And it's it's funny because like I think when people hear like the word negative be genuine kind of what you're describing, like from my perspective, it's actually a purely selfish exercise because you talk about, you know, like if you're a YouTuber, a way to fund what you're doing is to take sponsorships and and do x y z things. And for me, if I would if I was ever in that position, the reason I wouldn't do those deals isn't because of like any kind of like moral thing. I just find it impossible for me to think clearly the moment I have any it's it's like so naive to think that I'm still gonna be objective even though I'm getting money. I % believe you want to.
I % believe you really care about that. But having clarity the moment you have that, it's it's so so so so difficult. And to me, like, clarity is more important than anything. And Ivan goes like, me and you have a personal relationship, like we like each other. Even that affects my clarity, right?
Like I wanna see PlanetScale do a I like wanna like what you guys are doing. So I'm just like hyper aware of how easily you can kind of get caught up in this stuff. So then when I see people like hyping stuff up, my first thought is it's not really about like, oh, they're like confusing people. It's like they're confusing themselves. Like you're not gonna reach the right destination if you're confusing yourself to that degree.
Correct. A %. And that's the kind of crux of all of it, which is that genuine just knowing where you came from and what your like values are and just holding that like in the center and it's really hard and it's really difficult.
Yeah. It's really difficult.
It's really really tough. Like truly truly truly tough. It goes back to the marketing, goes back to like all of the advice and and and standard playbooks that people give you. What's it worth? Like people, you know, I had, you know, as a favor to a friend of mine who is an investment, they they had like three young kids that that, you know, they're like 19, 20 going into into college.
They they they're interning at great companies here, and they asked like, can I go to dinner with them? So I went to dinner, they show up like eager with advice, and I said, have zero advice for you.
Yeah. No. I've had less advice the older I've gotten.
Correct. When I was your age, I was sleeping on my friend's floor and I ate rice for an entire week because I'd spent all of my money trying to like Okay. Set up punctures. That's literally all I would do. I was an idiot at your age.
Like you are doing way better than I was. I don't know why like I said, the only advice I have for you is in your twenties, never say no to going out once. You're never going to get those Friday nights where you're like, oh, these are infinite, they're not. Like I am old and I get hangovers now. Right?
That's the only advice I had for them. I was like, what would I know? I don't know your generation. You you look at me like, until recently I was wearing low cut cut socks. That's apparently how they all know we're old. I got some new one. I got the bombers long ones now. Oh, Much nicer. But the point is is why would you care? Why would you give a shit?
Like, do you know what I mean? Like Yeah. I see a doctor more more I'm not sick or anything, I have to I'm like, yeah, I have to go and sit to your doctor. You don't see a doctor. You don't even know what feeling sick looks like. I was like, don't listen to me. There's nothing I have for you. And I also haven't achieved anything. Why should you look up to me in any way? Like, just just you don't, you know?
It's like, it doesn't you just have to kind of go and just build what's, you know, true to Yeah. And then you're lucky if it has economic impact. You're
just lucky. Yeah, I know. It's funny because I I have the same exact feeling as you where I used to give a lot more advice and then nowadays, I like look back at my career, I'm like, this doesn't make any sense at all.
Like I
just did a bunch of random stuff and one thing fell into the next thing and like it kind of looks like it makes sense. And what I'm doing now make is like super weird and I just can't imagine that advice working for anyone else because it was just like a weird thing that that worked for me. So at this point, I'm just like, I don't know what the world's like now, I don't know what like getting a job is like now, like I don't I just don't understand anything. So I have such little advice for anyone. Have like less advice now than I had five, ten years ago.
No, it's so funny. It's that confidence, like that midway curve, right? You just you get through the other side of it and you're like, yeah, I mean, all I know is all you find with experience is that how little you know, how not you just don't know anything. Like you just Yeah. You just have to be lucky.
People downplay because it's uncomfortable, it feels uncomfortable to just talk about luck, but it's just luck. My entire career changed because like one saw one guy at GitHub tweeted Yeah. Exactly. Frustration that they couldn't hire a database person. So I just DM'd them.
I don't know why I DM'd. My entire life changed, like everything. There's two people that exist in the world, my two children would not have existed if I said that to you. No, you're like seriously, like, you just can't plan it. But if you go out there every day and work really hard, because because that I I will say one thing, a true bit of advice is I'm not smart.
I'm not a smart person. I'm I'm by far the worst engineer that works at PlanetScale, right? But no one can will not let anyone outwork me. Mhmm. You know, you know, like because because smart doesn't get you anywhere without hard work.
And like, people always say like luck has to catch you working or whatever. I just I firmly believe that, you know. You just have to be Mhmm. Doing anything and something and like jump on it. Like, we a massive because of metal, a massive opportunity jumped in our lap this week.
We started already. But yesterday we made that decision instantly, we're doing the thing that we that, you know, I'll I'll come back when we ship that one. But like Mhmm. This is it's massive, it's as big as metal and it was yesterday the opportunity showed up and now we're started. We're just going.
We're just doing it. That's what it takes. It just takes like relentless drive and moving all your chips into one place over and over again and then luck Yeah. Will kind of find you. And other people that are also lucky that can create more luck will find you and you can just be there.
You just do stuff. Just do things. You you have the you can just do things is is just so incredible and and it's it's similar to like manifestation as well. I I seemingly simultaneously believe it's dumb and completely real at the same time.
No. It's true. And I think as I've gotten older, I've been like more into this stuff that doesn't seem logical at all. Just because I've just seen so much come out of stuff that doesn't exactly make sense but it kind of does in ways that you wouldn't expect. Yeah.
The the single decision thing is so crazy to me because I I think I think about this all the time now. I think I get physically nauseous and uncomfortable when I think about this. My wife who I met because she came in for interview and we ended up hiring her at the company I was
at. Amazing.
And she tells me that she almost blew off the interview. And I literally get like weak to my knees. She like just like almost flippantly just was like, this guy because she talked to the CEO of the company who who admittedly was kind of weird. She was like, he seems weird like maybe I was bald this interview. And like every tiny aspect of my life today that I absolutely love, personal life, career, whatever, like can branches out from that one thing and I just imagine her just like flippantly blowing it off and being like none of my life would exist and
It's crazy.
I literally get like, I'm like, I just can't handle that thought.
It's Mhmm.
It's crazy. So yeah.
Doesn't build a sense of gratitude though? Doesn't it make you just feel so lucky to be, like, alive and where you are and just it's just incredible. We're just so lucky to get to do what we do. Just even being in tech. I tweeted the other night, like Mhmm. We're just so lucky to do what we do. I mean, we just, like we wear sweatpants to work. And
I'm not even wearing pants right now, if I'm being honest.
Exactly. It's great. Yeah. Just let it go free. It's fine. Like, you can. It just doesn't matter. Like, whatever. And then, like, we just accidentally become like millionaires doing it. It's like, cool. Like, that's good. I mean Yeah. This cut this won't exist in a hundred years, didn't exist a hundred years ago, you know?
Yeah. It's wild. It's
like With so lucky.
Yeah. Your brain can't even really truly understand it. It's I think be just kind of beyond our understanding. The other thing I wanted to talk real quick about was I was kind of going back to this is totally out of order because we've totally moved off topic now, but just kind of bring it back to just like PlanetScale from like a year ago. When you guys made that decision, there's a few decisions you made.
You decided to shrink the team. You also got rid of your free tier to kind of focus more on mid and up market. There and it was really controversial. There's like a lot of commentary about it, specifically the free tier thing where people were like actually, don't know, like, what like do you like, what were some of the things that you were really frustrated about that you wish people like understood differently?
I don't think I was very frustrated at all. I think the the confidence at which people just said things, you know, I look back. I think the thing I got most wrong I'll start there because I you have to I have to I can't just make it sound like I'm Teflon. I won't take any feedback or, you know, won't let anything stick. Like I did so many things wrong with that layoff.
One of them was the messaging. Think it was very cold in in in reflection. I think the blog post was very cold. I did it, I sent it to my friends that happened to have either founded successful companies or just been CEOs or run a business or whatever. And they read the post and they were like, oh yeah, this is a they they they agreed with the decision. Mhmm.
And
so we're like, yeah, is good. You should just do this. And and and didn't and I didn't really think about the kind of how it would be read and conveyed and I think it came across very coldly as we're doing this. And that's kind of a problem with me which is like once I believe in a decision, like just go for it. Like I just don't care about even if I said the completely contradictory thing the day before, it just doesn't matter.
And I believed in this so much that I just wanted to do it and I did it and I and I I think I hurt people and I I I just I don't feel good that I I did that. I think that's fair critique that it it was a kind of a cold way to message something that had a real human impact. But then you kind of just saw this wave of stupidity that followed. Like like, you know, we put that we had a limited runway and then someone very famous with a very large audience got on camera and said, how is that possible? How can you have an infinite runway?
And you just think to yourself, when more money goes into our bank every month that leaves, what date am I supposed to choose for when we're gonna go out of business? Like, every venture backed founder has a cash out date in their head. They know that at the current rate of burn, without giant revenue inflection, their bank account will go to zero. Like every like ask your venture backed like vendors when their cash out day is. They know.
They know. They report it every every three months to their board. We will run out of money. If nothing else changes, a raise or a revenue inflection, we'll run out of business. So like takes like that, you're just like, wow, people are just hateful or stupid.
Like that's moronic. Like, you know, just help me if you you know, help me find the day we're just gonna go bust when we keep making more money. Like we ended the we ended the year with like way more money in our bank than we modeled. Like millions of dollars more than we thought we would have at the end of the year, we had it. That's thanks to our info team cutting loads of Klaus Ben and costume, whatever.
We did a bunch of that. But like the point being is that takes like that were silly. ASTRO were releasing a database product a week after we did the layoff and they were like, you know, and this is where I thought it was really amusing because like, you know, you know we kinda know what we're doing in databases, like that was never in question. You knew people knew what we were doing. We got and just did something very drastic.
In my mind, that would have made me feel humble, but instead they were like, wow, like, you know, amping it up and doing all this sort of stuff. Turns out they were wrapping another database platform that has lost data and shipped a product without backups, lost customer data, and then gave data away by having a bug that's literally impossible to do on our our platform, where they just served other people random databases. Yeah. Never unlive that. You'll never undo that.
Not not that we'd ever see or see companies like that in a competitive sale, but when they have competitors, just takes reminding people of that, and that's that's that's over. Like, you know, they shipped that. And you just think to yourself, like, the arrogance is unbelievable. Like, they just the level of arrogance and how little they know about computers. Like, they just don't understand them.
They just think it's just this simple thing, and as long as you do some good marketing and some little drawing on the you know, it works, and it just doesn't. And so stuff like that was just like, okay, you'll see. It was like that long game thing of like, yeah. I got home that night, and my wife looked at me, and she just burst into tears. And she's like, I've just read what everyone's saying to you on the Internet.
And I thought it was hilarious, like, sound dick, but, like, some really funny quips, so some really good ones. I just thought it was really funny. But, yeah, like, people go at you and it's not comfortable and you don't feel good and people remember it and whatever. But then you watch. You watch the outages.
You watch, like, the data loss and you're just like, yeah, that's the that's the long game. We're just gonna keep building. We're building metal. We're building this stuff. You can all confidently yap, but then do it.
Like, when we wake up at two in the morning to, like, fix figure out issues, I know, like, they could have infinite money and they couldn't fix these problems. They they literally could not. And so you just eventually stopped caring. But, know, at at the at the time, you were just like, wow, everyone is so wrong and they're so wrong about you and you want your you want a fair trial and you just can't get that in in the court of public opinion and it gets to you. And people have said to me, why do you care?
I don't know, I do. I just care.
It's it's impossible not to. I think it's easy when you're not in that situation to be like, oh, yeah, it's it's easy not to care, but it's basically impossible not to.
Yeah. A %. Yeah. People ask me why I argue on Twitter. It's like, well, I don't know. I know. I could but I care. Like, it it matters. Right? And other people care.
Like, we started to now see more folks interacting and kind of talking about the stuff they do at scale and and and and the realities of running in tech, you kind of realize, like, yeah, there's this dormant group of folks that do really amazing, interesting things, and they kind of wanna talk about it, and we're hopefully hopefully igniting a revolution for these people to go and actually talk about what it means to kind of do this stuff in reality. And that's why, again, why I like your stuff because you, you know, you have this kind of, like, you're not cynical. You know you have to build for an audience that's young and modern and doing amazing stuff, but you also just balance that with, like, it's still computers.
Right. Yeah. It's funny because we actually reference your guys' decision a decent amount. I just felt like it was so I think prior to you guys doing that, I had a lot of doubts with my position. Kind of what you were saying, right?
Like you you think everyone else you think you must be crazy because everyone else is doing things differently. But forever, I was just like, why is everyone obsessively going after this indie hacker free tier type of persona? Why is there a whole company oriented around that? In my head, was like this I'm like trying to see it, I can't see it. We are we doing anything wrong?
And then to see you guys have captured that a good amount more than us and then be like, oh yeah, that's like not worth it at all. Like that's actually a negative thing and it's gonna like screw us if we're if we keep going around that and like go the other way. Mhmm. That was like an important data point for us because that was the first time we finally saw someone in the space like like show that that that's that might actually be right. Like everyone's kind of chasing the thing that doesn't really make sense.
And then now, oftentimes we see companies that are like blowing up, like they're getting a bunch of usage or whatever. And I just the first thing we think about is like, man, what does their support look Like what Oh, how do Are they just going through complete hell right now because they're getting like the dumbest people that will never pay you just eating up your time. And we orient so much around how do we make sure that we build as though those people can use us, but like we're never in a situation where we're stuck supporting them.
100%. That is literally that is the that is the essence of it. You know, all of these people that have got negative gross margins because they just have tons of usage that will go nowhere. Like it's like just why? Like what what?
You don't need it. Like you you just you're completely right. Like, I mean, it's this is this is what people are gonna learn over time, which is, you know and so many people have founders have said to me, we're not doing a free tier because of you. Like, we just don't we're just we're just not bothering. And I'm like, yeah, I think that would be a good decision or it won't.
There's like tons of businesses I would start where I would have a free tier. Like, they would Yeah. Would be consumption based infrastructure businesses because how can you be serious about your company if you can't spend $39 to buy the same database that Cash App has? How can you not be serious? How can you be serious?
Like, seriously, just like, we're giving you a sign up flow that, probably, some of the greatest companies in the world in the world, tech companies in the world use money print businesses that just print money, and you can't you don't wanna spend $39 on that. You're gonna fail. You failed already. This is a test for you, and you have failed it. Like, no, I'm serious.
I'm serious. It's just like, yeah, you just have to not care. And then but again, it's gonna take ten years to prove that out. It really it really will take ten years. And people always go like, wow, what about net new?
I mean, people are the largest customer of one of these little Postgres startups is migrating to us now. They were they were told by that company, you are a largest customer. That's why you're causing a struggle. Yeah. It's like it's a order of magnitude below, you know, ACV even. So it's Yeah. One, if that's your large customer, that's very bad. Two, it's hilariously sized small database. It's like a hundred gig of data. Wow.
So it's just like, what's your free tier doing for you? If you're that's the peak of your conversion is that.
Yeah. I think people have this funny thing where they just put themselves in hell not realizing. The point of starting a company is to put yourself in a nice situation. Like it's gonna be hard for some time but ideally you get to a place where like a nice situation, you're happy with your with your life. And this thing where your customers graduate out of you, I never wanna build anything where my customers graduate because that's just hell forever Yeah.
Because you're just like, you're finally making money, you're trying to make more money, oh, and they're gone. And now you're like fighting this infinite battle. Like, that's just not a fun place to be. Like, why build anything that people will outgrow?
%.
I think you're stuck with the people that aren't paying you. So it's just like, it's complete hell.
You're just UBI for Indian software developers, do guys? It's just I mean, just like, you know, like we were Ubering to work for $5.
Oh my god. Was so good. I'll pay like $3 to go anywhere in Manhattan and it would take it would take forty minutes because of Uber Pool. It was it was fine because I was in my twenties and I had that much money. It was great.
Yeah. Exactly. Like, you know, the GitHub office was just Priuses just pulling up all morning just just just brilliant. The same Saudi money is now just going as compute
Right. Exactly.
For students to learn. Like, I I I those people are valid, I love those people. But I I can't like I I have a different type of business to build, it's just the way it is and and all of those ones that have got the hype and the tweet and their user graph, tweet your revenue, tweet your gross margins if you wanna
The the user graph without the y axis always. The y axis unlabeled.
Yeah. Like, it's like, hang on a second. We showed up with with my sequel in this world, right? And like gained so much traction of like just, you know, at the party there was like a guy that, you know, he's building a really cool company, new, young. I was like, is there any chance on earth you would be using n you'd be n you'd you'd be using Postgres like if it wasn't for Planetscale, right?
He was like, oh yeah, a %. It was, you know. So we showed up with that. You know, if the job if all the job is is light $30,000,000 on fire to make $2,000,000, I mean, that's fucking easy. I mean, I can do that.
Just buy Lambos and give them away for a third of the I mean, if that's that's all they're doing. Like, you see this hype and this, you see these user graphs. It's like, yeah, like any if the job is to light money on fire, like, to make no money, that's super And that's and that's that's the vanity of that's the vanity of tech Twitter, which is like Yeah. You know, David Kramer who's run Century is hilarious as well, you know. He puts it like, you know, he's built a phenomenal business and he puts like 10,000,000 MLR Yeah.
Yeah. I saw that. He removed that recently. I wish he put it back.
So funny.
Somebody didn't know who he was the other day and was being like, oh, how much money have you ever made? I'm like Yeah. Man, I wish he had that in his profile still. The the tens of millions MRR.
Yeah. Just to generate like a phenomenal product used by just thousands of amazing companies. And it's just like, just just goes to work and does it, know. Just like, take Twitter, that that's actually if I do I guess advice for anyone, it's it's all a mirage. It's like, when the fucking ACH clears for millions of dollars into your bank and all of your employees' bank accounts, that's when you won every minute until then is just a waste of time, you know.
Like it's just thinking about anything other than obsessively thinking about that like it's just air. Yeah. And at the end of the day like there's a graveyard of dead companies that looked incredible
Yeah.
All the way through and made and then there's these rocket ships that just slowly build. Like like I always like remind people that if you were a snowflake at the stage PlanetScale is at right now, you'd be like dead company. Like, sales d, flat revenue growth, two CEOs fired and then it's the long game and then they go off like a rocket. Yeah. It's just, you just can't tell and it just takes way GitHub, again, ripping hot company, sold for an amazing, you know, exit to Microsoft in year 13 or whatever.
Like, it's a long grind to go and do this and checkpointing today's Twitter optics as in any form form of indication of future or success or failure is dumb.
And there's just so much reinforcement of this. If you look at YC companies that were like the hot YC companies during demo day, if you like analyze them, it actually like were like the worst. Like you you get you like perform they perform really badly. It's Yeah. It's so hard to again, going back to like being able to get clarity, it's like that stuff just creates so much noise.
And I'm back to the thing you were saying about the free tier and $39. That's the thing that was so funny to me because everyone was like really upset that the free tier was gone and to me and I was like, the discussion like like when I was talking about I took it for granted, okay, the free tier is gone. But like hold up, $39 a month is free. Like to me that's like that's Like that is free. Like how is that?
Like, we would never even think about think about that. So it's just funny that there was so much debate over the free tier is gone, but like, man, it's like still just basically free, you know.
I I wanted extra protein with my sweet green salad the other day. $28 for a salad. If we find like like Yeah. It was fine. I just watched I watched her like out of the little trough, just scoop the pre allocated three ounces of chicken, right, for $6.
And then you just think to yourself, we could end thousands of businesses today by fucking up. Thousands of companies could just go. Right? Like when CTOs of public companies sit you down and go, if we go bust, you go bust, you're like, hey, you have a $300,000,000,000 market cap. That's a sobering realization and people can't and like, people don't want to pay $39 for like that. Yeah, I know.
Doesn't make any sense for You're
not serious. Look yourself in the face and say, what else are you gonna do that's so you know, like, it's just so that that is the point of the free tail. Like, you know, don't want to hate on hobbyists, I don't want, like, indie devs, whatever. You do whatever you want, but like at the end of the day, I have a viewpoint. They have a viewpoint. I only care about mine.
Yeah. Yeah. And that's actually the tough part about all this. It's like, it's not exactly that they're wrong, it's just that I don't wanna I'm not interested in engage like talking to you guys about your world. Like I wanna talk in my world about the stuff that I care about with other people that are also in my world.
But when you're on online, it's just like everyone just interjects into each other's stuff. Mhmm. So yeah, like the things that I'm doing look ridiculous from your point of view but like,
I'm not talking
to you. I'm not saying you should Yeah. Look like this. I'm not saying you should do any of this stuff but it's not doesn't mean it doesn't make sense.
That yeah. It's the it's that famous hacking news comment to Dropbox. Right. You just ask and convert Yeah.
We've been on a we we managed to do between terminal and SST, we've been on Hacker News I think four times this past like with past year or so. And I get so stressed every time it happens. Like I used to there used to be this thing where I'd be like, man, I'd love to like do something that like makes it on Hacker News. And I have a feed I go through with like Hacker News and bunch of other stuff. I remember I was reading something, I was reading an article and I was like, man, this guy is getting roast in the comments.
I feel so bad for him because he's being misinterpreted blah blah blah. Like, I was reading that. Then I swipe up to the next one and it's one of our stuff and I'm like, fuck. So now I'm just like, I wanna be out there, but at the same time, I'm too out there because I
Yeah. Know. Know exactly what you meant. Yeah. You're like, you you're kind of too close to the fire. Yeah. No. It's we it's the same for us, which is like, yeah, it's good, it drives some traffic, the comments are just crazy and then nothing changes, you go back to doing whatever you Yeah,
I know. You know, it just It becomes normal.
Is that what's that meme, like, know, is it like the Tyler Creative, like, cyberbully? Like, just close your laptop, bro. Like, it's just like, that's it. You just log off at the end of the day,
you know? Yeah. I was saying this the other day, I was like, there's so many companies that don't that can't do it. Like if you were honest with yourselves like, you just can't do the internet thing, like it's not Mhmm. In your skill set, you don't have to. You can just not do it. I feel like so many companies do it and do it badly. Actually totally valid just to like opt out and not do it. You can can still do a lot of things. Still accomplish a lot of things.
This isn't gonna be your one of your channels, but whatever.
Yep. Yeah. The whole like hello fellow kids.
It's just like if can't if
you can't play then it's only downside for you if you jump into this you
can just ignore it. You can just completely ignore it.
%. Hundred %. Well, unfortunately, I've got a day of customer calls to go and do, so I'm gonna have to part ways and say thank you again for having me on. Obviously, love spending time No.
I appreciate you coming on.
Adam, whatever you are dealing with right now, I hope that has gone well.
I don't I don't think it has but I appreciate that.
Sending you love, Adam. But yeah, thanks for having me and just like thanks for producing something that gives me a little value and delight every week.
Yeah. Congrats on the the launch and yeah, we'll flip our stuff over at some point when I have a chance to look at it. But yeah, excited for You're
in the you're in the top tier of support, CEO support.
Yes. Yes. No. I I talked about that a bunch. Yeah.
Whatever you need. Whatever you need. Thank you.