¶ Intro / Opening
This episode of Search Engine is brought to you in part by Mubi, the global film company that champions great cinema. From iconic directors to emerging auteurs. There's always something new to discover. If you're looking for something really special, check out Father, Mother, Sister, Brother, the eagerly awaited new film from Jim Jarmish, now streaming on Movie in the US. It follows adult children navigating their relationships with somewhat distant parents and each other.
It stars Tom Waits, Adam Driver, Mayam Bielik, Charlotte Rampling, Kate Blanchett, Vicki Cripps, India Moore, and Luca Sabat. Mubi is a curated streaming service dedicated to elevating great cinema from around the globe. Perfect for lovers of great cinema and for anyone who who hasn't discovered how much they love it yet.
To stream the best of cinema, you can try movie free for thirty days at movie.com slash search engine. That's MUBI dot com slash search engine for a whole month of great cinema for free.
¶ Introduction: The Evolving Driver
Before we start the story today, I want to ask you to imagine a different version of your life. You're you, but it's almost 200 years ago. And unfortunately, in our hypothetical, it's Monday morning. It's Monday morning, and it's very early, pre-dawn, you wake up to this really hard rapping at your window.
That's the knocker upper here to get you up for work. We're in the 1800s before the invention of the adjustable alarm clock. The knocker upper is a job. The knocker upper walks the neighborhood with a long stick and Sit on the windows of people's houses early in the morning to wake them up for work. Who wakes up the docker upper for work? Nobody knows. But this is a job. A job that'll actually exist for another century. Outside, the gas street lamps are still burning.
The lamplighter lit them the night before. He's supposed to come at dawn to extinguish them, but it's so early that he hasn't yet. Your lamplighter is one of those neighbors you have a deep fondness for. A fixture. Every day you watch him make the rounds at dusk. with his ladder at his light.
You yourself are a driver. Professional driver, 200 years ago, is also a job. You're a person who sits on a coach and holds the reins of a horse. You take passengers where they want to go. You start your workday. Okay. Hypothetical over. Two of those jobs are obviously so long disappeared that most people don't know about them. The knocker upper is your iPhone alarm. The lamp lighter is the electric streetlight.
The third one, driver, has persisted as a job for some, as a routine human task for nearly everyone else. This is a story about whether that's about to change. It's about how the word driver, which right now makes me picture a human, could soon transform to refer to a machine. The same way the words dishwasher, printer, and computer all did.
I've thought about this maybe too much in the year I've been working on this story in conversations constantly. I'd ask the human same same question. Are you a good driver? Are you do you consider yourself a good driver? I do within limits. I think I'm a good driver because I understand the limitations of my driving. This is Alex Davies. He wrote an excellent book called Driven, The Race to Create the Autonomous Car.
Alex, like me, thinks a lot about human driving, about his own personal limitations. What are the limitations? The limitations are that I can't always pay attention to everything, that I get tired. I've been trying really hard to be calmer in the road. My husband and I are expecting our first baby this fall. Congratulations. Thank you. And I thought that along with like reading all the baby books, a good project to work on is just be calmer in the car.
A very good resolution, because of course, for most of us, driving is the riskiest behavior we routinely engage in. In fact, even Alex, despite his good intentions, would actually get in a car accident just a few months after we first spoke. He was okay. It was the car that was totaled. Safety is the entire pitch for the driverless car, which is really a car driven by a computer. Driverless cars don't get drunk, tired, or distracted. They never text or feel road raised.
And these driverless cars, they aren't the future. They're actually already here. But it's funny, if you just don't happen to live in a place that already has them, it's easy to not see how fast things are changing. Robo taxis, like Waymo, are operating in 10 American cities, providing millions of rides to Americans. In China, the rollout is happening even more widely, through twice as many cities.
But here, if you live in a place like San Francisco or Austin, today a driverless car is about as exotic as an Uber. A passenger in those cities opens up their phone and decides who should drive them, a human driver or a robot driver. How that happened is a story. A story we are living through right now, whose ending promises to totally reshape the places we live. And today we're gonna tell you how we got here in chapters.
¶ Early Dreams of Driverless Cars
CHAPTER one DREAMES WITHOUT DRIVERS So it turns out this dream that inventors have had to replace the human driver with some kind of machine, that dream is about as old as the lamplighters. People have been thinking about a self-driving car for
So it's about as long as there's been a human driven car. Why? There's this funny thing you lose when you move from the horse to the human driven car, which is that In a horse-drawn carriage, the horse is not just gonna run off a cliff if you let go of the reins. sentience in your vehicle. When automobiles first arrived these powerful and There's actually a passionate fight to keep them off the streets. It was the 1800s, and people feared these new things.
The steam powered vehicles thundering down the road. Soon evolved into powered vehicles also thundering down the road. The fear was partly about jobs. These vehicles were seen as a huge threat to a whole network of working class jobs. Horse breeders and horse farriers are
Horse feed suppliers, horse manure haulers, horse carriage manufacturers, not to mention the Teamsters. Teamsters, today the word makes me think of the Teamsters Union, but originally the Teamsters were the workers who drove teams of horses. Teamsters were like truckers before we had trucks. Cars seemed to imperil all these horse-related jobs. And even if you weren't worried about these workers, the cars were also less safe. Some anti-car activists battled to stop or slow the new technology.
Mainly with regulations. There were red flag laws, which said if you had an automobile, you had to hire a person to walk in front of it, waving a giant red flag to warn people. In Pennsylvania, a law was proposed requiring horses. Morseless carriage drivers who encountered livestock to stop, disassemble their car, and hide the parts behind the bushes. But the thing about these crazy anti-car activists. It's a dragon.
Right. Those cars did initially wipe out a lot of jobs, even if they created more. And cars were very unsafe. The cities that threw their doors open to cars without regulation were rewarded with astonishing death rates. Detroit let drivers pretty much run wild. In the early nineteen hundreds, deaths accumulated in a Detroit without driver's licenses, stoplights, or turn signals. Many of those deaths were children. It took decades for society to mostly learn to live with complexity.
The rest of the story is just the word. We invented laws, licenses, drivers, We learned to better design roads. We invented the highway, the seatbelt, the airbag. All those things made driving less deadly, although the smartphone reversed some of that progress. Nationally today, deaths from cars are about as common in America as deaths from guns or opioids. About one in a hundred. It'll probably happen to someone you know in your life. Maybe several someones.
Whether or not you see that as an urgent problem to solve depends on you. But as long as there have been cars, there have been people who wanted to truly solve what's left of the safety problem. The best way we knew how. They wanted to make the car more like the horse it replaced. Make the car more sentient. So that thought is there early and like early visions of it include, oh, we'll we'll have radio controlled cars.
Because they had radios at the time. There's a real effort at one point to build magnets under the rope. And at each stage, what a self-driving car can be is dictated by the technology that's available at the time, for the most part. Yeah. No one's thinking that much about A vehicle that thinks for itself. They're just thinking about a vehicle that the person in it doesn't have to drive.
Many different attempts, many different failures. As many wonders as we invented, we could not approach nature's most majestic creation. A horse's brain. At least not until the turn of the millennium. Deep within the Department of Defense, there's a little-known military agency that has created some of the most innovative technology of the 20th century.
¶ DARPA's Autonomous Vehicle Challenge
Chapter two DARPA's million dollar prize. drivers. DARPA's always been intrigued with This is from a documentary called The Million Dollar Challenge. Honestly less a doc, more an ad for DARPA, The Pentagon's Research Arm. DARPA's mission is to try to keep American technology one generation ahead of everybody else. It doesn't always work, but DARPA has invented or funded a lot GPS and the M sixteen, the early internet and the predator drone.
In two thousand two, DARPA decided to pursue the driverless car in a very unusual way. The director of DARPA at the time, a guy named Tony Tether, who had been a door-to-door salesman in his youth, definitely has that flair and that way of thinking, says Let's have a contest. Let's see who can put all of these ingredients that we've developed together into a proper self-driving car. His original idea is we'll drive him down the Las Vegas strip. That's almost immediately next because it's insane.
Oh right. You would have to like literally gridlock a huge American city so people could put robot cars on it. Exactly. So he says, okay, do you know what we'll do it in the desert? We'll do it in the desert outside Las Vegas. And anyone who wants to can make a team, build a self-driving car, bring it to the desert, and we'll race.
The driver that DARPA wanted to replace was the American soldier. DARPA wanted a vehicle that could drive itself down roads that might be filled with hidden explosive devices. So in this moment, at the tail end of the dot-com boom, DARP is trying to inspire tech to build something besides another website. DARPA's Tony Tether announces that the prize for whoever can win its grand challenge will be$1 million. The rules were very open.
There were little rules like you couldn't have two vehicles communicating with one another, but you could build any kind of vehicle you wanted. You could have six wheels, it could be a truck, it could be a motorcycle, it could be a tricycle. It just couldn't attack other vehicles. That was ruled out early on. Oh, was that a concern that people would just like sort of battle bot the thing? Your autonomous vehicle would have like a little shredder that would take out somebody else's?
Someone asked in the first QA at this, like they said, can we attack other vehicles? And they said, no. And it's funny you bring up battle bots because a lot of teams who entered this had battle bots. History. Interesting. They were used to building robots for interesting purposes. And when they caught wind of this, they said, We can do this, we can scrap together some money and this'll just be fun.
I'm gonna tell you what happened in this robot race in the desert, not because I care so much about these early robot vehicles, but because I care a lot. about the engineers who were making them. These would be the people who would later go on to lead development for the billion-dollar companies creating today's driverless cars. And these people had very different views about how to get that technology ready.
different values when it came to things like the acceptability of risking human life. Abstract differences that would become very concrete later on, to the point where people would be charged with federal crimes. That's the future. But listening to this part of the story, what I listen for is how much of it can you detect already? How much are the differences already present? The first engineer I want you to pay attention to is a man named Chris Earmson.
And way back in two thousand two, how did you end up being part of the DARPA Ground Challenge? Um, it sounded like fun. Uh Chris, these days the CEO of a large tech company. Back then, a PhD student at Carnegie Mellon University.
When he first got recruited for the race, he was out in the field observing a robot as it crept across the Atacama Desert, training for its future deployment on the surface of Mars. My PhD advisor came down and was really excited about this DARPA Grin Challenge thing and the idea that you'd have a robot run across the desert at fifty miles an hour just sounded exciting, um, having spent the last couple of weeks walking behind a robot at very low speed.
So Chris would join Carnegie Mellon's red team and help build a car called Sandstorm, a bright red Humvee with the top lopped off, a plethora of futuristic sensors mounted to it. Like scanners a crackpot would use to search for aliens. You can see Chris back in that documentary. He explains to the filmmaker at the time that the hard part, of course, isn't the vehicle, it's the driver.
How do you even begin to teach a computer to operate a Humvee at all? How does a computer make the steering wheel turn? How does a computer change the pressure on the brake and the throttle? Those are the issues that we're fighting through right now. Sandstorm represented the best entry from the contest's traditional academic crowd, but there's a different crowd there too, represented best by a man named Anthony Lewandowski. Can you tell me about Anthony Lewandowski? Anthony Lewandowski.
Where to begin? So Anthony is like an entrepreneur. He's a really charming guy. He's six foot six. He's gangly as all get out. He grew up mostly in Belgium because his mom was working for the EU. For high school he moved to Marin to live with his dad. And he's a hustler. My name is Anthony Lewandowski. I was a grad student at uh Berkeley. Instead of continuing on to finish my PhD, I decided it was much better to do the grand challenge.
We asked Anthony for an interview. He didn't respond. But here he is in the footage from back then. Anthony did not have the engineering experience or resources of a team like Carnegie Mellon's red team, so he tried something very different. A vehicle that had almost no chance of winning the race, but which was also perfectly designed to stand out, to get him a lot of attention, maybe a job.
The race's only self driving motorcycle. It was named Ghost Rider. A stubby little thing covered in stickers, with an antenna on the back and cameras on the front. There's a steering actuator on the top here which allows us to uh modify the steering angle. So basically if you're driving you start to fall to the left, you steer left, that makes you turn the left and then you get centripetal acceleration to put you back up to the right.
And you're monitoring that in real time and making small adjustments and you stay bounced. The strobe light is on. The command from the tower is to move. Ladies and gentlemen, sandstorm. The race happens on a Saturday in March of two thousand four. autonomous vehicle traversing the desert with the goal of keeping our young military personnel out of harm's way. Booyah. What happens the first time they try to do this competition?
¶ First Race Disaster & Software Insight
The 2004 Grand Challenge is an utter hysterical disaster. Disaster number one, Ghost Rider, the motorcycle. Anthony Lewandowski forgot to flip on the switch for the stabilization system. The bike immediately topples. Ghost Rider down. Anthony. Good effort. And then every vehicle after it fails miserably. Like one vehicle drives up onto a berm, flips off. One vehicle drives straight out, does an inexplicable U-turn.
And just drives back to the starting line. And the rules are that once your vehicle starts, you can't do anything. Even Sandstorm got stuck on a burn. Chris Eramsen just standing there, unable to help his robot. Poor thing was trying to get going, but its wheels were
Just spinning on the gravel and tried so hard that it actually melted the rubber of the tires. And so there's this plumes of black smoke before they killed it. For the roboticists, this was obviously very disappointing. Chris Earmson compared it to an elliptical. an Olympic marathon where the best runner only makes it two of the 26 miles. What this contest had done though was it had flushed all these inventors out. It had jumpstarted the scene that would develop this technology.
One of the most important people there that day, actually just watching, was someone I haven't mentioned yet. A legendary roboticist named Sebastian Thrun. Sebastian Thrun, he was at the first grand challenge. He didn't bring a team, he wasn't participating. Garpo wanted to show off some other projects they'd been funding, including one of his robots, so he brings the robot and so he's there. And he watches this disaster and he thinks I can do better than this.
This, of course, is Sebastian Thrun. He grew up in West Germany, moved to the US, taught at Carnegie Mellon before moving to Stanford. Watching that day, he saw this. This fundamental error he believed all the entrance had made. I saw that all the teams Treated this like a hardware problem. They looked at this and said we have to build a bigger wheels and bigger chassis and and so on.
Um and I looked at this and said, well, wait a minute. The challenge really is to build a self-driving car that can drive the desert. I can get a rental car that can do it just fine, provided there's a person inside. And the challenge is really to take the person out of the driver's seat and replace it by a computer. That is not a problem of bigger tires. That's actually really a software problem. Sebastian Thrun had a dual background, robotics and artificial intelligence.
focus here on the robot driver's mind. He was thinking about something else too. The military wanted this tech to replace a relatively small number of drivers in its war zones. But Sebastian was already imagining something. What would happen to traffic deaths worldwide if one day Everyone had access to a driverless car.
I had experiences of losing people in my life to traffic accidents and I felt we we lost over the million people in the world to traffic accidents. Wouldn't it be amazing if DABO invented something that would save a million lives a year? In October of 2005, 43 teams have brought their vehicles to compete in a unique event. A race driven not by testosterone. But computer code.
¶ Stanford's AI-Powered Victory
Chapter 3. Machine Learning The race course is a circular maze that zigzags for 1320. 18 months later, for the second grand challenge, DARPA doubled the bounty.$2 million. This footage is from a PBS documentary called The Great Robot Race, narrated to my mild joy, by John Lisgau.
Familiar faces have returned. Chris Earmson back with the Carnegie Mellon team, this time with two vehicles, Highlander and Sandstorm. Anthony Lewandowski back with his motorcycle, which still doesn't work. He's knocked out in the qualifiers. And now there's also Stanford's entrance. Compared to Sandstorm, the bulked up Hummer, the car looks measly, a blue SUV donated by Volkswagen, a baby faced thrun smiles next to his soccer mom looking vehicle.
The vehicle's name is Stanley, so Stanley is nothing else but Stanford. But it also gives the vehicle a personality. We think of the vehicle more and more as an intelligent decision maker. Thrun is a computer scientist. And Thrun really brought more artificial intelligence, which at the time we're talking 2005. Was still rather primitive, especially compared to what we have today. But he could use it to teach his vehicle.
How to recognize the road and how to do it much faster. They found a dirt road out near Stanford and they drive it down a dirt road. And have the car's cameras record what they were seeing. The robot Stanley was able to train itself as it ran, and the way it worked is its eyes looked way ahead and it could see stuff way at distance. When it drives over the stuff, you could tell if was it a good place to drive or not, because it could measure how slippery or how bumpy the vote was.
And then you could then retroactively train and say, look, this green stuff over there, it's something good to drive on, aka grass, and this brownish stuff, aka mud, is not so good to drive. And so it was able to detect patterns and generalize from what it had learned. Yeah, absolutely. And it did this like thirty times a second. I mean just like a person. The race kicks off with Stanley sandwiched between Carnegie Mountains to Behemoth.
What happens in the second race? The second race is as successful as the first race is disastrous. Nearly every entrant in the second race would go further than Sandstorm had in the first. Multiple vehicles would finish the course. The real question was who would do it fast. And so w at what point was it clear to you that you were going to win?
Well once we passed the front running team, we kind of saw the vehicle descend into what was the hardest part of the race course, a a very, very treachery mountain pass. And and we saw uh at a distance a dust cloud, we saw a helicopter, we saw little features that made must believe, wow, there's something happening that's magical. And this dust cloud then all of a sudden turned bluish because the car was blue and came closer.
And then it came uh first to the finish line. It was unbelievably magical. At the end of the dock over some criminally corny piano music. Sebastian Throne gives his post race interview. He's dressed a lot like a race car driver, watching you could forget he wasn't in the car. It was just amazing to see this community of people. That community succeeded today. Behind me, there are three robots that made it all the way through the desert.
And all three of them did the unthinkable. It's such a fantastic success for I think we all win. A made-for-TV kumbaya moment, still years before the race to build driverless cars, would enter its cutthroat phase. What would happen next is that a small band of lunatics would take driverless cars out of the desert, start secretly driving them on public roads in the state of California. At the behest of a man who had been observing from the standard.
in a hat and sunglasses, who'd watched the challenge. Have you ever felt like you were living just a dangerous to live that more dangerous than a B minus Plus life because when you're living a B or B plus life, you don't change it. You think it's good enough. Is it? I'm Susie Welch. I host a podcast called Become. Listen to Becoming You wherever you get your podcasts. Welcome back to the show.
¶ Google's Secret Autonomous Project
Chapter 4. Something actually useful for the world. The race in the desert had been designed as a spectacle, something flashy, to draw out America's smartest roboticists. But it had drawn another person, who'd come for his own reasons. Google's Larry Page arrived at the DARPA Grand Challenge. In a baseball hat and sunglasses, a disguise. He found Sebastian Throne and buttonholed him, asking him a million highly specific questions about things like.
the wavelength his LIDAR system used. But this meeting in the desert, this was not actually their first introduction.
Well, the first time I met Larry was a bit earlier. He had built a small little robot that acted as a telepresence for meetings, and he was trying to drive it around the Google offices instead of himself going to meeting with a robot. And he uh he sent me a message and said, I'm gonna show you the And I in a spur of like craziness, I send a message back saying Larry, I'm so glad that Google lets you use 20% of your time to do something useful for the world. I don't know.
I I either expected a rapid response or never hear from him again. It turns out I was lucky. He responded immediately. I took his robot, I fixed it the next 24 hours, and he was very happy. It turned out. That's what he'd wanted to do his thesis on before being guided by some wise PhD advisor toward search engines instead. Now, as a spectator at DARPA's second grand challenge, he could see real-world evidence that autonomous vehicles might actually be.
At first, Larry Page hires Sebastian Thrun along with fellow DARPA contestant Anthony Lewandowski just to build what will become Google Street View. They'll actually modify the system that Stanley the car's roof-mounted cameras had used to begin photographing American. But before long, Larry Page returned to the And so how soon after arriving at Google does Project Chauffeur begin? Like Larry Page says to you,
Uh I have a mission. Like how does this happen? This is a an embarrassing moment for me. It's about two years later, two thousand nine, where Cinema Cubicle and Larry Paige comes by and says, Sebastian I think you should build a self driving car that can drive anywhere in the world. And my immediate reaction was no. Taking the technology we built for this empty desert and put it in the middle of Market Street in San Francisco is gonna kill somebody.
And Larry would come back the next day with the same idea and I would give him the same answer. And both of us got increasingly more frustrated. Like, God damn it, it can't be done. And eventually he came and said, look, Sebastian, okay, I get it. You don't want you can't do it. I want to explain to Eric Schmidt, the CEO at the time, and Sergey Brin, my co founder, why it can't be done. Can you give me the technical reason why it can't be done?
And that's the moment of incredible pain because I go home and I can't think of a technical reason why not. There was this kind of moment where I felt, look, I'm the world expert on self-driving cars. And I'm the person who denies that it can be done. Like that taught me an incredibly important lesson about experts.
That for the rest of my life I I decided experts are usually experts of the past, not the future. And if you ask an expert about innovation, something crazy new, they're the least likely person to say yes, it can be done. So this is where the Google self-driving car project begins in 2009. It's led by Sebastian, joined by others from the DARPA Challenges. The methodical Chris Armson was running most things day to day.
Anthony Lewandowski, the flashy motorcycle guy, would work on hardware. Dmitry Dolgov, another DARPA veteran, would be responsible for planning and optimization. It was a secret project. They'd report directly to Larry Page, a small enough team that there'd be no bureaucracy, few emails, fewer meetings. Just 11 engineers who writer Alex Davies says represented some of the best young talent in the country. And so Google builds this very quiet team and it says to them.
Build us a self-driving car. And because that goal is super nebulous, they give them two challenges. They say safely log 100,000 miles on public roads. But they also give them a challenge called the Larry One K. So Larry and and Sergey and I sat together and the two of them carved out a thousand Total miles of road surface in California? They open up Google Maps and they just click around and they look for ten separate 100 mile routes. that are really tricky.
absolutely everything, like the Bay Bridge and Lake Tao and Highway One to Los Angeles and Market Street and even Crooked Lombard Street. And they say to the team, you have to drive each of these one hundred mile routes. Without one human takeover of the system, without one failure of the car.
To get off to a running start, the team licenses the code from Stanford's DARPA Urban Challenge vehicle. Anthony Lewandowski goes to a local Toyota dealership and buys eight Priuses, takes them back to Google, and retrofits them to accept a computer as a driver. He hooks that computer driver electronically into the brakes, the gas, the steering. These Priuses get a radar system behind the bumper, cameras, a LIDAR system spinning 360 degrees on top.
LIDAR like radar, but it shoots lasers instead of sound waves. At first, the team gives each Prius a cool name, like Knight Rider. But I think we quickly realized that we're not going to be able to name all these vehicles as we scale up our fleet, and so we just started to number them like, you know, Prius 27. This is Don Burnett.
He'd been a researcher working on autonomous submarines. He lost a friend in a car accident, separately got in a bad accident himself, and decided he wanted to do work on self-driving cars. That's how he eventually ended up on the team in its early days. I was on the motion planning and behavior decision making team, and my responsibility was to work on the nudging behavior. Nudging when a big truck passes a human driver on the right. The driver will nudge a little to the left.
For us, it's an instinct. Don't job was to teach a computer to nudge. You're trying to encode the behavior that you would use as a driver under kind of partially good perception. And it's a really tricky problem.
¶ Mastering Human Driving Nuances
A team of academic roboticists, some of whom had had friends die in cars, spending Google's money to see if they could make driving safer. It was a weird era. There's this big concert venue near Google's offices called the Shoreline Amphitheater. In two thousand nine, you could have seen Cheryl Crow there, the killers, fishing. But the most interesting show that year was one almost nobody knew about. In the venue parking lot, on days when there was no con. No tour buses around.
The Google team would run its first test runs of their driverless cars, essentially hiding in plain sight. A Prius driving itself around the amphitheater parking lot with an attentive safety driver sitting behind the wheel, just in case. The team was making sure the basics functioned, that the sensors could really recognize another car, that the computer in the car was abiding by their orders. These were the baby steps.
They'd happen in this parking lot and at an empty airplane runway that was close to their office. Spring 2009, the team tries actual real road track. Chris Earmson takes one of the Prius' out on the Central Expressway. Speed limit, 45 miles per hour. There are humans driving here. And immediately, outside the confines of the empty parking lot and the empty airplane runway, here's what's clear. They had a real problem.
The car was swerving wildly. Uh it was weaving around like a drunken sailor. And we realized that the scale of the runway was such that you didn't notice the one or two foot kind of oscillation it had. in lateral control and you put it on Central Expressway and suddenly, you know. Turns out actually that's a problem. One more problem to fix. Listening to the story, it's funny because I can imagine it giving me a totally different feeling than it does.
A tech company, with nobody's permission, was testing driverless cars on public roads in California. I don't know why that strikes me as being about invention instead of just hubris and impunity. Maybe it's because I know that Google would be one of the few tech companies whose driverless cars would not cause any fatal accidents in testing. And that the team would just take more safety precautions than the other companies who'd rush in later to catch up with them.
once this was an arms race. The way these cars were designed, the safety driver sat behind the steering wheel, ready to take over. In the other seat was their partner, Watching the monitor displaying a graphical interface designed by Dmitry Dolgov. The people watching the screen would call out problems ahead, some discrepancy between what the sensors were seeing and what was actually in the road.
This is what teaching a car to drive actually looked like. Two-person teams manning the cars, logging errors, going back to the office to troubleshoot, and then updating the code. I asked Don Burnett about this era.
And while you're doing this and then like you leave work and you get in your car that you drive as a human, did you find yourself thinking more carefully like, How do I know what I know when I'm driving? Like you're trying to teach a machine by day. Did it affect how you thought about human driving by night? Almost obnoxiously so, to any passengers in the car with me, I was obsessed with the one big question, which is why do humans drive the way they drive?
And it turns out there were no good answers. And I still think there are not great answers. And instead of actually answering that question, we've just turned to machine learning to infer the deep truths behind why humans do what they do. And so there's some basic principles that you can
understand like we try to minimize lateral acceleration, meaning you don't want to be thrown to the outside of your car when you're making a turn. So you're gonna slow down. But how much do you slow down, right? And it turns out that's contextual.
So you're trying to figure out the right speed and angle for the car on one of those tight curvy on ramps onto the highway. You want it to feel comfortable for a passenger. Don says you can work out the math. The lateral acceleration is two meters per second squared. But the surprising thing is that number only applies on the on-ramp.
If I put you at a cul-de-sac in a neighborhood and you were gonna do a U-turn at the end of the cul-de-sac, even though the speed is significantly slower, If you did two meters per second squared of lateral acceleration around a cul-de-sac, you would tell your driver they were crazy. It was incredibly uncomfortable.
Like incredibly uncomfortable. You would feel like you were in Mario Kart. Yes, it would feel Mario Kart. And and and remember this is a force. So it's a physical feeling on your body is exactly the same, but the contextual awareness of the situation. Of speeding up to get on the highway versus making a U-turn in a residential street tricks your brain into feeling. Opposite about the situation. And so it turns out the limit for a cul-de-sac is around 0.75. It's almost three times less.
Then you would be willing to tolerate as you accelerate onto a highway. And so there were things like that where you just say humans have specific physical restrictions, right, from a forces perspective. The context matters. And when the context matters, now all of a sudden anything is game. So It things like that is where I spent my time as a researcher trying to figure out, okay, how are we gonna make this comfortable for passengers? All these little problems to solve, but there was one guess.
which was that the team at this point had an overarching goal uniting them. The DARPA challenge had told them, drive across this patch of desert. The Larry 1K challenge told them, drive these 10 routes without human intervention. The specificity of the mission meant they never had to squabble about why they were there. By 2010, just a year in, the team was really on a roll.
They start knocking out routes each one of the routes was unique and distinct and different and had its own challenges. Down Route 1, Silicon Valley to Carmel. The bridges run where we had to go across all of The bridges in the Bay Area, starting in Mountain View, finishing, crossing the Golden Gate Bridge. It's Chris Earmson in the car, it's Anthony Lewandowski in the car. I was in the car with Dimitri, Chris, and Anthony. It was the four of us in the Prius. They're figuring out the
technology much faster than they thought they could. The Larry 1K was set up like a video game, meaning they'd get to try the route over and over until they could complete it without a single human takeover. Then they'd move on to the next one. It was really a proof of concept exercise. Can you even make this happen once? When they fail a route, they know what the car can't handle. So they go back and say
So you have to be better at doing XYZ. And then we got back to the office. We regrouped. We went back out, I think, at like eleven PM, and by one AM we had completed the route. They buy a bottle of Corbell champagne. They all write their names on it. Corbell, thirteen ninety nine a bottle, the champagne they have at Trader Joe's. And one by one. The Larry 1K routes and I think this is gonna take them about two years when they start out, and they do it in a little bit more than a year.
As they had expected. Here's Chris Armson. And I think we had a big party up at Sebastian's house in the Los Altos Hills. So you know it was pretty spectacular, right? They throw each other in the They celebrate and then they're not going to be able to do that. What to do next? It was kind of uh okay, and now what? The team had pulled off a kind of miracle in a year. A driverless car with human supervision, with lots of human coding.
A driverless car successfully navigating some very tricky roads in They'd done this safely, they'd done it quickly, and now things would begin to wobble. Competition would arrive, the team itself would begin to schism, and one member believed that the team was moving too slowly would actually take matters into his own hands Extreme. After the break. Welcome back to the show.
¶ Product Vision, Internal Strife, and Uber
As early as 2010, Google's driverless car project had developed some very impressive self driving. But what they were struggling to decide was this. What was the actual product they were developing here? Here's Sebastian Thrun. had a big debate we should just buy Tesla. And Tesla was worth two billion dollars at the time. I remember this.
Maybe we should have in hindsight. Um but uh joking aside here, there was a debate whether this is more of an assistive technology or a disruptive replacement technology. route the Tesla. Would design self-driving as a feature in your car, something that could take over sometimes but still need human monitoring? Or was it better to wait until the car could fully drive itself?
Thraun would eventually come around to this version of self-driving. Specifically, he'd come around to the idea of self-driving robotaxis. A taxi service type system Is way more capital efficient than ownership. An owned car is being used about four percent of the time and it's parked ninety-six percent of the time.
imagine a city without parked cars where every car is being utilized call it 50% of the time. Which means we have like only 10% number of cars needed that we need today when we all own cars. That's gonna happen. There's no absolute question. What Sebastian is describing here so matter-of-factly is a fairly radical reimagination of American cities. The idea that robotaxis would be so cheap and widely available
That most people just wouldn't own cars, that we could put something else, anything else, in the places where we put most of our parking lots and parking spaces. That is a far-fetched idea. Just given how much of American identity is tied into personal car ownership. A far-fetched idea. And for it to begin to happen, Google would have to bring a product to market. But the years passed, and they didn't.
And some people who were there felt stuck. Don Burnett says he believes life at Google got dangerously cushy. The food was great, the money was too. These former academics making much more than they'd ever expected. There was a lack of urgency on the team to actually make something viable. We had a funding supply that effectively felt infinite.
And maybe it was, maybe it wasn't, but it certainly felt infinite. And when you have infinite funding, you're not forced to make hard decisions. You're not forced to focus. You're not forced to look at the opportunity, the market, the customer, and be the best. It was more like, hey, let's take our time, let's make sure we do it right, which is on its face.
A good principle. But at the end of the day, I think the lack of urgency uh wasn't for everyone. And within the team, you got Team Chris and Team Anthony. And they start butting heads all the time. Chris and Anthony, meaning Chris Armson, official head of the project, versus Anthony Lewandowski, who I still think of as the motorcycle guy. The main difference in their approach is how quickly they want to move. Anthony is very
Okay with risk, we'll say. He gets one of these cars and he's driving it back and he lives in Berkeley, works in Palo Alto. He's just using this car like on the Bay Bridge every day. probably outside the bounds of what the team actually wanted. Yeah. And he's not like necessarily logging data. He's just enjoying his self driving car and taking it all over the place. Chris comes from an academic background. He's that Canadian. Very nice, very careful, very risk avert.
When I asked Chris Ermson about all this, his memory was slightly different. In his memory, Team Anthony was pretty much just Anthony. And Anthony, he said, was a move fast and break things kind of guy. Move fast and break things, a motto famously coined by Mark Zuckerberg. It defines a way of developing technology which once might have felt cute and revolutionary, but which today, at least to me, feels pretty irresponsible. Chris didn't think that philosophy was an option for their team.
Even if their cars were statistically safer than human drivers, he knew that the first news story about a self-driving car in a fatal accident was going to be a huge deal. Anecdote was going to demolish data if they weren't extremely careful. By all accounts, Anthony Lewandowski felt differently. But he actually wasn't the only one. Here's Don Burnett. There were some people on the team, very famously, including myself, that started to get the itch kind of towards the three to four-year mark.
the itch of like, okay, where is this going? Who is it for? How are they going to use it? Where are they going to use it? And I felt like the leadership didn't have great answers to that. There was no commercial race, right? We had no competition and there was no market for the product. But competition would soon arrive in the form of Uber. This was the oh shit moment for me. Uber announced their self-driving program. And I remember like it was yesterday, waking up, reading the news.
Going to my desk in the morning and thinking, oh crap, these guys are gonna eat our lunch. In 2013, then CEO of Uber, Travis Kalinek, had gotten a ride in one of Google's prototype driverless cars. Sitting in a taxi without a human driver, he'd understood that this could mean the end of his company. And so Uber had plunged. headlong into the driverless car race.
The company hired nearly half of Carnegie Mellon's top robotics lab. And not long after, we also know through court records and emails that Uber also began communicating with Anthony Lewandowski. who in twenty sixteen would leave Google, quitting just before he could be fired for recruiting team members away, including Don Burnett.
Anthony would then start his own autonomous vehicle company. Uber would soon buy that company for almost$700 million, even though the company had no product and was only months old. Betrays to mystery. Why would Uber pay so much for a company whose only asset seemed to be its people This is where Google goes into its computer security logs and realizes that not long before he left, Anthony Lewandowski downloaded something like 14,000 technical files onto his computer.
And move them onto an external disc. Obviously you can't do that. I mean I'm assuming obviously you can't do that. No. You definitely cannot do that. And this is the kind of thing that maybe if he had stayed there, this is the kind of thing Anthony would have done and he would have been like, oh, it's just so I could have access to it somewhere else, and he probably would have gotten away with it.
But when you then go and work for Uber and start running their directly competitor self-driving car program. That's when you get in trouble. And that's when what's technically called Waymo at this point, Google's program. Sues Ucker and puts Anthony at the center of an enormous legal battle between these tech giants. Secrets and subterfuge in Silicon Valley, a former Google engineer has been charged with stealing files from Alphabet's self-driving car project and taking them to Uber.
Specifically, it involves a former lead engineer of Google self-driving car unit, Anthony Lewandowski. Now he's accused. of using his personal laptop and downloading more than fourteen in twenty sixteen Google had just spun its driverless car unit into a new entity, Waymo. Waymo sued Uber. Uber had to settle to the tune of two hundred forty five million dollars. And in a separate criminal trial
Anthony Lewandowski pled guilty to stealing trade secrets. Afterwards, Uber continues their driverless car program without him, continuing to pursue its move fast break things strategy. Which in twenty eighteen. Leads to the death of a woman named Elaine Hertzberg. Uber is sitting the brakes on its self-driving cars after one of them hit and killed a woman in Arizona. The вікоol was in autonomous mode, but it did have a safety driver on board.
But a police report later indicating the safety driver was streaming TV shows on her phone for three hours that night, including at the time of the crash. The way this story was reported, nearly everyone blamed the safety driver. She was on her phone. She was streaming an episode of The Voice.
¶ Fatal Crash, Waymo's Safety, and AI
Tempe investigator saying had Vasquez been paying attention to the road, she could have stopped the car forty two feet before impact. The NTSB slamming Uber There were some important additional contacts. Which is that Uber's robot driver was also just much worse than Waymo's. A statistic I found jaw-dropping. At this point, Waymo safety drivers were having to take over from the car once every 5,600 miles. Uber safety drivers that year had to intervene more than once every 13 miles.
Despite that, five months before the crash, over employee objections, Uber had cut its safety crews. Instead of two humans, they just used one. One safety driver overseeing a robot driver that was arguably not ready to be on public roads. In the last moments of Elena Hertzberg's life, The robot spent an indefensible 5.6 seconds. Trying and failing to guess the shape in the road. It was a human body pushing a bike. Over those 5.6 seconds,
The robot kept reclassifying her. Was she an unknown object? A vehicle? A bicycle? During that time spent wondering, the car did not slow down. Soon after Elaine Hertzberg's death, Uber halted its testing program. Uber has temporarily suspended its driverless fleet nationwide as the NTSB. Police, Uber, and the National Highway Traffic Safety Administration investigate. We reached out to Uber for comment. A spokesperson said that the fatal collision was indeed a tragedy.
which had a significant impact on Uber and the entire industry. There would be other competitors who would shut down after similar accidents. There would also be Tesla, Which by 2020 was publicly marketing a product the company called full self-driving, but which absolutely was not. Meanwhile, Waymo had slowly continued to develop its tech. Their robotaxis would be ready for riders by 2020. The team had gotten an unexpected boost from a technology that was At the time, very little understood.
In 2026, when most people talk about artificial intelligence, the conversation defaults to products like ChatGPT and Claude. But artificial intelligence has been a core part of driverless cars going back two decades. In the 2010s, neural network Net advances meant that you could now begin to feed a computer system large amounts of data and watch as its perception, prediction, and decision-making abilities improved.
That technology of master data training was with us from the get-go, but has become more and more and more and more. For all of us has been that size matters. When you put a million documents into an AI, it's fine. A hundred million is fine. But when you put a hundred billion documents into an AI, it is unbelievably smart. And that I think shocked everybody. I say haven't put it.
The Google Brain team, the deep learning people, started working with the driverless car team to use training data to help the computer driver learn things, like how to better predict when another car was about to suddenly switch lanes, how to more reliably spot pedestrians. Over the years, as the car drove more miles, as the team gathered more data, plugged that data into their AI systems, and tweaked those systems, the engineers say the robot driver kept improving.
As they tested the car in new weather conditions, they discovered problems that required hardware fixes. For instance, in Phoenix, Waymo had to design miniature wipers for their car's lidar sensors to deal with the dust storms and heavy rains. In 2020, Waymo finally debuts to the public in Arizona. In the years after, it'll roll out to 10 more American cities.
A funny consequence of Waymo's long development cycle is that the public's attitude towards Silicon Valley has just really changed in that time. There's more suspicion towards Google than there was back in 2009 when the project first started. And so now many people look at the Waymo driver with a raised eyebrow, with a question immediately on their lips. Chapter five.
¶ Waymo's Public Debut and Safety Data
Are you a good driver? Driving through Austin is here. Except it comes without a driver. A fleet of white electric jaguars covered in forty different sensors, cameras, radar, lidar. It's an expensive car, as much as one hundred fifty thousand dollars by some estimates. In the news stories, you see the inside, where the human driver would normally sit, there's an empty seat, you're not allowed in, with a steering wheel in front of it.
front of it. Vestigio. It turns itself. Cars without drivers are here. Yeah, sounds like something out of the Jetsons, but get ready because you may look over at the car next to you. And see it rolling down the street. The TV newscasters always use the same gee whiz tone. They can never resist the Judson's reference.
In every city, the influencers hop in to record testimonials for their daily serving of clout. So in today's video, I'm about to take my first ever driverless car. It's with an app called Waymo. Waymo is basically driverless car Uber. Where it's like ride service, you call it, you go wherever you need it to go, but there's no driver. You guys, this is creepy. It's like I'm being driven around by a ghost person. It's a little terrifying. It is definitely Robo taxis pull hilariously badly.
According to JD Power, a data analytics firm, among people who've not ridden in one, consumer confidence is at twenty percent. But among people who have taken a ride, the number shoots up to 76%. It's a thing I didn't capture in this story, but when I sat in one a couple years ago, I just found it persuasive as an experience.
You know what? I'm not as nervous as I thought I was gonna be. This is actually quite relaxing. Nice gradual turn. Felt very safe. Well, you know, it was kind of freaky at first. But now it's pretty chill. It's a smooth ride though. It wasn't driving fast. It wasn't jerkin'. It's driving like you always hope.
Uber driver would. So I guess that's one of the big sellers. Chris Ermson, the methodical team leader, had left Google years ago. But he told me about his experience as a civilian consumer, trying a Waymo out in the world. And my universal experience has been, and and you can tell me if this was your experience, the first couple of minutes in the vehicle, um, it's huh, that's crazy. I there's nobody behind the wheel. Ooh.
swim with sharks. And then a few minutes in, it's like, okay, you know, is this just gonna drive? Is that all it does? And then, you know, ten minutes in people are looking at their phone. People tend to feel safe in these cars, but are they? Actually. So we know that the Waymo driver has now driven over 200 million real world miles. And they've released safety data so far for the first 127 million miles.
Waymo's fairly transparent. They release their crash and safety data unredacted to the public. By contrast, Tesla redacts the details of its crashes. The company says they are confidential business information. In Waymo's case, I've looked at the data. I've looked at how the company interprets it, how skeptical, independent researchers interpret it. I wanted to walk through it with an autonomous vehicle reporter I trust.
His name is Timothy Bealey, author of the newsletter Understanding AI. I asked him how much our picture of the Waymo safety data has been evolving. So it's been pretty consistent the last couple of years. They are scaling up and so all the numbers get bigger, like the total number of miles get bigger, the number of crashes get bigger, but the like crashes per mile have not changed a ton. Waymo says, and I think this is correct that it's roughly eighty percent.
safer in terms of crashes that are severe enough to trigger an airbag, crashes severe enough to cause an injury, and also crashes involving vulnerable road users like pedestrians or bicyclists. So 80% fewer airbag crashes than human drivers, and actually 90% fewer crashes that cause a serious injury. Some independent experts have small quibbles with the methodology, but broadly they find Waymo's data crash. Timothy pointed out there's one very important thing we don't know.
The fatal crash comparison. For every hundred million miles humans drive, we cause a little over one fatal crash. The Waymo driver has driven 200 million miles without causing a fatal crash, but statistically speaking, that could still be. Some academics have suggested we need about 300 million miles to have statistical common. In the hundreds of millions of miles the Waymo driver has traveled, it was involved in two fatal crashes, which it did not appear to cause.
Here are the details of those crashes. In one, a speeding human driver rear ended a line of vehicles at a stoplight. There's an empty Waymo in the line of struck cars. In another crash, a Waymo was yielding for a pedestrian. It was rear-ended by a motorcycle. The motorcycle driver was then struck by a second car. That's everything.
When Timothy B. Lee looks at the entire safety picture, the results we have so far from this big experiment Waymo is conducting on American roads, what he sees is mainly promising. so far it's been better than human drivers. And so far I think the case for log that we continue the experiment is is very strong.
¶ Edge Cases and the Future of Work
Which doesn't mean we shouldn't scrutinize this Waymo experiment as it continues. I find myself paying a lot of attention to Waymo crashes, which Isn't hard. They make headlines. The most harrowing one recently was this January. A child near an elementary school in Santa Monica is struck by a Waymo. A child ran across the street from behind a double park car and a Waymo hit the kid. Santa Monica police say the child, a ten year old girl, was not hurt.
The company issued a statement. Waymo said its driver had braked hard, reducing speed from seventeen to under six miles per hour, a faster reaction they claimed than a human driver would have been capable of. What happened next at the accident scene actually answers a question I'd had. What does a Waymo do after a car crash since there's no human driver to help?
Waymo employs what they call human fleet response agents, human beings who can't remotely drive the cars, but who the car can ask questions to if it gets confused. In Santa Monica, the Waymo called one of those humans. The human called nine hundred one, and this is the strangest part of Waymo's statement. Apparently the car then waited at the scene of the accident until the police dismissed it.
That's what we know so far, but there's two federal agencies investigating this crash. And so we'll have a full report in the future. One problem that's not really captured in the safety data that I've seen is what I'd call troubling edge cases. You see them in videos on social media. A Waymo gets stuck at a dead stop light or blocks an emergency vehicle. Or an example Timothy gave. Waymo's were driving past stopped school buses in Asta.
I think it's reasonable to say this is like a clear cut rule that the vehicle should should follow this rule. These educators are still very rare. And so if it's a one in ten million thing, I think it's not that big a deal as long as they are making progress, which for most of these I think they are.
Timothy pointed to one area where Waymo's not been as transparent as he'd like. Those human response agents, some of which are based here, some in the Philippines. There's questions about what specifically they do and about how this will all work as Waymo scales up. We asked Waymo for comment on everything you heard in this episode, especially the recent safety incidents.
A spokesperson said that the data to date indicates that the Waymo driver is already making roads safer in the places where they operate, and says that Waymo continues to work with policymakers and regulators to improve its technology. That's the safety picture so far, which to me, after many months of looking at this and talking to experts.
Looks pretty good. As Waymo continues its rollout, other companies are quickly falling behind. Amazon's new driverless taxi is launching in Las Vegas this summer and There's other robo taxi companies like Amazon Zooks. Uber is back in the mix, not making technology, but
partnering with these robotaxi companies. We ride recently struck a partnership with Uber to bring its AVs to Abu Dhabi, another sign that we're going to be able to do. And many of those early Waymo engineers are now CEOs of autonomous companies themselves. Dimitri Dolgov is actually co CEO at Waymo, but other team members run driverless.
Trucking companies. Got Don Burnett, founder and CEO of Kodiak AI. Don, thank you so much for joining us. It's good to see you again. Don Burnett is head of Kodiak AI, which has its technology deployed in driverless trucks in the Permian Basin. Please welcome CEO of Aurora. Chris Ermson, a big round of applause. Chris Ermson now heads Aurora, which currently has semi trucks on Texas. my personal favorite pot to bell. I just broke on the information that Uber found.
is starting a new self-driving car company with financial backing from Uber. Partnership with Anthony Levendow. Now for those who've been f- They say there's no second acts in American lives. Somehow both of these men seem to be on their fourth. The big picture though is that everywhere in America today that you see a driver, taxi, truck.
Food delivery. There are several companies working on the robot version, trying their best to make driver as a job start to go the way of the knocker-upper, of the lamplighter. Those knocker-uppers, by the way. They disappeared quietly. The lamplighters did not. Writer Carl Benedict Frey tells the story of the lamplighters. Had their strikes plunged New York City briefly into darkness, to the delight of lovers and thieves.
In Vervier, Belgium, the lamplighters' strikes turned violent, ending in an attack on the local police headquarters. The army was The lamplighters lost their fight, in part just because they were so outnumbered. But the drivers today fighting to save their livelihoods are a significantly bigger force. Stand up. Union members. Yeah. 4.8 million Americans It's one of the most common jobs we have. And these workers do not have
the California tech companies. They're doing this because they stand to make an unfathomable amount of money if they driving jobs for working class people. I understand it is a business. It is But not in my city. At the expense of our jobs. These drivers are represented by unions. Politicians and in cities across America, blue cities, they're organizing. So far, they're winning. Humans drive this city, not machines.
Labor drives this city. Keep the workers in the workforce. If it works in another city, great. Have fun. Not here. Not Boston. Next week the Save a job. To save the human driver. Thank you for listening to our episode.
I just want to say making deeply reported stories like this one is only possible because for our listeners, particularly our premium subscribers who pay to support the show, we are releasing our full interview with Sebastian Thrun, who used to lead Google X, their secret special projects lab, totally
Totally fascinating conversation with the kind of person who just sort of lives in the future and has a million strange ideas about it. We are releasing that for our incognito mode members only. It'll be in your feed. If you would like to know the future, sign up at searchen.show. And again, your membership specifically enables projects like this one.
The Search Engine is a presentation of Odyssey. It was created by me, PJ Voat, and Shruti Pinamanini. Garrett Graham is our Emily Malterra is our associate president. Theme, original composition, and Bazaria. Our production intern is Piper Dumont. Reese Dennis, thanks to the rest of the team at Odyssey. Rob Mirandi, Craig Cox, Eric Donald, and the colour. Gainer Mark. Francis, Kurt Court. Thanks for listening.
