Drilling Deep: Karen Hao on How Big AI Is Gambling with the Planet’s Chips - podcast episode cover

Drilling Deep: Karen Hao on How Big AI Is Gambling with the Planet’s Chips

Mar 17, 202653 min
--:--
--:--
Download Metacast podcast app
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episode description

What is “artificial intelligence”? Is it a fancy technology? A management consulting buzzword? A PR effort to inflate corporate share prices? A political project designed to shape the world more to the liking of the billionaire class? A way to replace needy human workers with machines?

Perhaps it’s all of that—and more. In her groundbreaking book Empire of AI: Dreams and Nightmares in Sam Altman’s OpenAI, award-winning journalist Karen Hao argues that AI—and the profit-driven infrastructure that surrounds it—is a colonial project. What OpenAI boss Altman and his fellow ideologues in Silicon Valley are pursuing, Hao says, is not just corporate power but imperial power. They are building empires. And as history shows, empires are built on resource extraction, particularly the old-fashioned kind: of labor, energy, minerals, land, water.

Seemingly overnight, tech elites’ feel-good climate promises have evaporated, having been seamlessly swapped for slippery promises that so-called “artificial general intelligence” will save the planet for us. Never mind that AGI is a fantastical concept that has no agreed-upon definition, or that, more fundamentally, it appears nowhere close to existing. In Big Tech’s frenzied pursuit of the “hyperscale” AI dominance that evangelists claim will unlock AGI, as well as its expanding alliances with fossil fuel-backed petrostates and authoritarian political movements, the industry has become an increasingly central contributor to the climate crisis.

In an October conversation with Drilled, Hao discussed how Silicon Valley giants appear to be following the oil and gas industry’s playbook of disinformation and deceit; how Altman and OpenAI’s secrecy and disingenuous rhetoric transformed the field of AI research into corporate PR; and why the destructive trajectory of AI scale and commercialization is not inevitable—no matter what its power-hungry proponents would have you believe.

See omnystudio.com/listener for privacy information.

Transcript

Speaker 1

Pushkin.

Speaker 2

Hello and welcome back to Drilled. I'm Amy Westerbelt. Today we're bringing you another installment of our ongoing series Drilling Deep, where we speak to authors of recent books that are either about climate or about things that intersect with climate in a big way. Today is a super timely one. We're going to talk about AI. Specifically, we're going to talk about Karen Howe's new book Empire of AI, Dreams

and Nightmares in Sam Altman's Open AI. In this episode, Adam Lowenstein interviews journalist Howe, who argues that AI and the profit driven infrastructure that surrounds it is a colonial project. What openI boss Altman and his fellow ideologues in Silicon Valley are pursuing, how says, is not just corporate power, but imperial power. It makes sense when you think about the fact that AI, at its core, its most basic and ongoing purpose is about twenty four hour surveillance to

keep all us plates in line. These guys are building empires, and as history shows, empires are built on resource extraction, particularly the old fashioned kind labor, energy, minerals, land, and water. It seems like almost overnight, big techts feel good climate

promises have evaporated. They've been swapped seamlessly for slippery promises that so called artificial general intelligence will solve climate, never mind that it's a fantastic concept that has no agreed upon definition, or more fundamentally, that appears nowhere close to

actually existing. In big tech's frenzied pursuit the quote unquote hyper scale AI dominance that evangelists claim will unlock AGI, as well as its expanding alliances with fossil fuel backed petro states, fossil fuel companies, and authoritarian political movements, it's

become an increasingly central contributor to the climate crisis. In an October conversation with Drilled, How discussed how Silicon Valley giants appear to be following the oil and gas industry's playbook of disinformation and deceit, how Altman and Open AI's secrecy and disingenuous rhetoric transformed the field of AI research into corporate pr and why the destructive trajectory of AI scale and commercialization is not inevitable, no matter what its

power hungry proponents would have You. Believe that conversation is coming up after this quick break and find a condensed written version of this interview on our website at drill dot Media.

Speaker 1

How does it feel having the book out? Because it's it's a monumental achievement. I know you've gotten lots of praise for them already, but it's just it's just epic and I can't imagine the amount of work that went into producing it.

Speaker 3

Yeah, I was the most intense and painful thing that I've ever worked on me, like emotionally and physically painful because I was typing so much that I developed tendonitis on my hands. But yeah, I know, it's I mean, it's I think it's been interesting. Have you ever written a book before?

Speaker 1

It was not as long as Empire of Ai, but I have some understanding of the like the long term nature of a writing project like this, but not to the same extent with the amount of reporting in the yashion that you were wrestling with here.

Speaker 3

The thing that I didn't really prepare for was like the one to eighty flip from being completely alone and isolated working on the book to like suddenly talking with like thousands of people about the same thing once the book was launched, And that has been both like a very fun and new experience, and one that comes with like a lot of relief that like people are resonating with the thing, and also like a very uh like slightly not slightly extremely chaotic transition, because like you go

from like mode of like total silence and not having really feedback from anyone about anything that you're doing, to suddenly getting bombarded with everyone's thoughts about what you've been working on. So yeah, so it's like it's like a it's like a strange mix of relief and and like new sources of stress since the price.

Speaker 1

Have you heard from either sources or industry players with feedback about the book.

Speaker 3

I've heard from a few sources who really loved the book, which is always a relief. M M.

Speaker 1

Yeah, you want to do them justice for sharing their stories.

Speaker 3

Yeah, And I've I've heard from some like people within industry that are not like exacts, but you know, employees at these various companies that I've mentioned that were not sources, but that have mentioned that they really appreciated the book. But in terms of like formal responses from Open AI for other companies, there's been nothing, which I much prefer to like a lawsuit, So I'll take silence any day. Yeah, for sure.

Speaker 1

One of the things I found most troubling eye opening the way that you convey how artificial intelligence or the concept of it is an ideology in Silicon Valley and in these companies. And one of the things that the book does such a brilliant job communicating, and that I wanted to convey in this conversation is the fact that these are not like normal companies, and this is not

a normal technology, whatever normal means. Yeah, can you talk a bit about how AI is an ideology and then how these companies are already or are pursuing this status as what you describe as empires.

Speaker 3

Yeah, So if you think about just the fact that, like if we look at the history of AI and the founding of the discipline, the scientific discipline in nineteen fifty six, even back then, it was already an ideological project because it was a group of scientists deciding they wanted to try and replicate human intelligence and computers. And that's a very political choice, Like why do that? You know, from a it's not really clear what the scientific reason is.

It is more of a of just like a there was an intention behind that choosing that path and setting up a field that defined its goal as attempting to

mimic and therefore ultimately potentially replace humans. And Joseph Weisenbauman, MIT professor, who was kind of part of the initial co word of scientists who did start researching AI, then later quickly became a critic of the entire endeavor, still back in the nineteen sixties, and he said at the time, in a very prophetic way, there is something inherently disturbing about a goal that intends to replace a thing that we already have, because ultimately, all this is going to

do is allow people empower politicians and corporate CEOs to impose their will through algorithms and use the AI system as the load bearer of responsibility, essentially, like it allows them to do whatever they want, but to say that

something else did it. And so he was already recognizing back then that there's an ideological project behind the creation of AI, and so fast forward all the way to today, that ideology has not only continued to permeate and drive the industry and its goals, it has now become much more extreme because they're layered on top of this fundamental assumption that it is somehow inherently good to recreate human

intelligence and computers. We now have a particular approach to doing that that these companies index on, which is scaling at these models at all costs, which is also an ideology. There is no scientific basis for choosing that approach, and there's no scientific reason for why these companies are trying to dominate as monopolies. This is also based on these worldviews and values that a certain small group of people have chosen, and that group of people have an extraordinary

amount of power to make that choice affect everyone. I'm really glad that you're asking about the ideological aspect of it, because I think this is a really huge part of the story of AI that has often missed. People keep thinking that this is just a business story. It's you know, Silicon value doing commercial things and ultimately trying to drive for profit maximization. But that is only half the story

when it comes to AI. There is a deep ideological drive to recreate human intelligence too, and a belief in the idea that this is somehow going to create to solve all of our problems or potentially destroy us, and that in order to do all these things that we have to consume the entire planet's resources and all of those that need to be scrutinized for what they are, which is actually just an extremely narrow view about how the world is and how it should be.

Speaker 1

The idea of artificial general intelligence or AGI, I think, is something people hear about a lot these days because obviously it's great for headlines, and it's also great for CEOs of these companies to throw out as an idea, you know, implying that it's already here or it's just around the corner is a great way to boost a stock price. But they also, as you show in the book, they also use the idea of AGI is basically a

pretext for whatever they want to do. Can you talk a little bit about what AGE is or as close as we can come to a definition, and then how they use this hypothetical concept to basically justify whatever it is they want to do.

Speaker 3

Yeah. So, the loosest definition of AGI is the point at which an AI system fully encapsulates all the dimensions of human intelligence, which was the original definition of AI. And the reason why we now use the term AGI instead of AI is because over the decades, the term AI has sort of been cheapened by the fact that companies keep using it to market existing products and services, and so now AI has come to mean what we have currently and AGI is supposed to indicate a return

to that original premise of this scientific discipline. But the problem why AGI is so ill defined is because we don't have scientific cosensus around what human intelligence is. There's no signs, there's no neurological, biological, psychological definition for this special characteristic that humans seem to have more of than

other animal species. And in fact, like when you think about the history of trying to measure, quantify rank human intelligence, it has always been driven by extremely dark, dark motives eugenics,

the justification of oppressing different groups of people. And so this is why AGI remains an extremely nebulous milestone because different people have totally different ideas of what does it mean that we've finally achieved human level intelligence and open eye jokes about like this has been a long standing

joke within the company. If you ask thirteen AI researchers what AGI is, you'll get fifteen definitions, and so you know, they're kind of self aware about the fact that this lacks consensus, but it becomes a tool that the executives use to their advantage, and Altman in particular in that because there is no neither a definition within the company that has full consensus nor externals of the company that has full consensus, they can just paint these visions of

AGI based on whatever is necessary to overcome a particular hurdle that they're facing in that moment. So when Altman is speaking in front of Congress, you'll paint AGI as this magical system that is like a magical want that you can waive that's going to solve climate change, cure cancer, do all these things that people have wanted for a very very long time. And then when you're talking to like CEOs, AGI suddenly an employee like something that they can buy as a service so that they don't have

to hire real humans. And then when you're talking to you know, an average consumer, AGI suddenly a friend or it's an assistant or whatever it is that you know compels that person to put down money or compels the

regulators to not put in regulation. And so AGI just shape shifts and morphs in these ways that when you actually list out all of the possible things that supposedly AGI is that Altman or any other company executive has ever said it's a completely incoherent vision of a technology, like it just doesn't make sense, and like opening eye uses.

They've also written down in documents completely different definitions of this as well, Like they just they officially say on their website that AGI is highly autonomous systems that outperform humans and most economically valuable work, So they are defining

it as a labor automating technology. But then in their contracts with Microsoft, as reported by the Information, AGI is apparently an AI system that can generate one hundred billion dollars in revenue, which is like a completely different definition. So yeah, it's just it's just a rhetorical tool forgetting what they want.

Speaker 1

On a side note, and I think this is probably obvious to a lot of people, but I think still bears emphasizing is the hunger that corporate CEOs have to get rid of their needy employees. And by needy, I mean like healthcare benefits, vacation, parental leave, potential union organizing. They salivate at the idea of replacing workers with machines, and so you can see how the concept of AGI would be so appealing to a CEO.

Speaker 3

Absolutely yeah, and this is why this has continued, in part to be a self perpetuating myth. I guess you could say that it is possible to build AGI is because there is such a high demand for that magical thing that a rep sense that it is just all of the market incentives and all of the political incentives push Silicon Valley to continue propping that myth up and using it to dominate the narrative.

Speaker 1

Something you mentioned earlier and that you trace throughout the book is the way that the promise of AGI solving the climate crisis has been used to rationalize really unfathomable

environmental costs. And you describe it at one point in the book as a gamble that are basically saying, like, it doesn't really matter resource consumption, the land grabbing, not to mention the human exploitation that it requires right now, because this magical mystery technology will solve this crisis that we're contributing to in a massive way at some point

in the future. Can you talk a bit about that gamble that they are making the planet's chips, even though no one actually gave them those chips to play with, but they're basically the extent to which they do not seem to care about any of the impacts of the technologies they're building because of this future promise to solve this existential crisis. It's really pretty astonishing.

Speaker 3

It is incredibly astonishing. Yeah, I think the first to just quantify what level of environmental impact we're talking about, there was this McKenzie report that came out earlier this year that did an estimation on how much energy would actually be required to sustain the current projections of AI industry growth, and we would need to add two to six times the amount of energy consumed by California onto the global grid in five years just to sustain the

AA industry and its state of center of demands. That is insane. That is six possibly six times the fifth largest economy in the world, and there have been, you know, other projections that have said that's more energy than all of India, the largest energy consumer at this point globally, and most of that will come from fossil fuels. So we are not only talking about an acceleration of climate change, we are also talking about an acceleration of air pollution.

We are already seeing reports of methane gas turbines, for example, being used to power Colossus, the supercomputer that Elon Musk built for XAI and for training Rock in Memphis, Tennessee. That's pumping thousands of tons of pollutants into working class communities that have already had a long history of being denied the fundamental right to clean air for decades. And we also see the exacerbation of the water the clean

water crisis. There is a huge crisis of people getting access to clean drinking water around the world, in part due to the acceleration of climate change, and AI also exacerbates that. There was this investigation from Bloomberg that found that two thirds of the data center is being built for the AI industry are going into places that are already scarce on freshwater resources, and data centers require freshwater resources to cool in order to make sure that these

extremely expensive computer chips don't overheat and bust. And so you have this multi layered environmental public health crisis kind of being pushed to the brank and undermining people's fundamental ability to live a decent quality life. And that's happening now. This is not speculative, like this is literally playing out currently, and the AA industry justifies all of this base on a speculative assumption that maybe we will get to a point where these AI systems can then fix all of

those problems. And that is the thing that is so mind blowing to me, is that in this AI era, somehow future speculation can be used to justify present day, real world substantial harm. And the question that I always ask people is like, how long do we wait for this potential speculative future. How much harm do we suffer before we realize that future might not arrive and we might not survive these harms. And of course, like the people who are ultimately making the decisions, they're not the

ones that they're the brunt of these harms. They're not the ones that are bearing the brunt of climate having changed already, and they're not the ones breathing in this toxic air from fossil fuels burning in their communities. And so for THEMB the question of how long can we kind of bear to do all these things before we potentially reach euphoria is really really long compared to most of the rest of the world.

Speaker 1

There's a lot of ways in which the tech industry broadly but especially AI, if there is still any separation between the two seems to be following the fossil fuel industry playbook, and one of those ways seems to be this narrative of you know, A, this is inevitable, It's happening whether we like it or not, and so we might as well might as well be the ones doing it. And b this is the you know, the price of progress, and if you are against this, then you're against human progress.

These really powerful narratives of inevitability and progress really struck me because it's the exact same rhetoric that the fossil fuel industry has been deploying in some form or another for decades.

Speaker 3

Yeah. That's such a great point, I mean, and it is the trump card for any industry that knows that they're engaging in something that's deeply incorrect. And yeah, I mean,

these technologies are not inevitable. Like the thing that I spend a lot of time trying to do with my book is document the moments in which open AI employees made decisions that fundamentally shape the trajectory of how the technology was introduced into society based purely on you know, whims of judgment, Like technology is always a product of human choices and sometimes those choices are actually seem really

minor in the moment. Yeah, So, like, how can it be inevitable when the shape of a technology can be swayed one way or the other based on just like a person sitting in a room deciding on the fly to do one thing or another and the other thing with progress. So yeah, this is like the thing that I hope we can have a more nuanced conversation about

moving forward. Is there's always this idea that the tech industry perpetuates that AI is there's only one form of AI, and so if we want progress from AI, we just have to accept the costs of this progress, meaning the colossal environmental impact, the colossal public health impacts, and so on and so forth. AI is actually a collection of many different technologies that work in very different ways, that have very different costs benefit trade offs. And I often

make the analogy that it's like transportation transportation. There's many different types of transportation, and when we talk about how we need to improve our transportation options as part of client resiliency and fighting climate change, we're not saying like we just need more transportation. We're saying we need more bikes, we need more public transit. We need less gas guzzling trucks.

We need to electrify cars. There's like a much more nuanced conversation about like which mode of transportation are we talking about, and how to tweak and tune and adjust the supply and demand of each of these different types of transportation in order to get that progress. And we need to have a similar nuanced conversation about AI. The large scale AI models that Silicon Valley has imposed on

everyone that I describe as an imperial consolidation project. That is the form of AI that is the most costly and has very unclear benefits that just do not justify

those costs. But when talking about the kinds of progress that we would actually want in general, putting technology aside, like things like wanting client change to be resolved, wanting better drugs, better healthcare for treating different types of diseases like these are there are actually types of progress that we already know how to build AI systems for that

look fundamentally different from these large SCALEI systems. Those types of AI systems they're task specific, they're often very very small and cost extremely small amounts of energy to develop. They're trained on highly curated data sets that do not require the type of labor exploitation and content moderation that goes into something like Tatgybut and they have already documented.

We know that when we build these systems, we get benefits on the end, rather than this speculative maybe in the future will reach AGI one day and it will

solve everything. And so once you kind of realize that, once you realize there's actually a portfolio of different options for the shape of AI and what it can do, it suddenly becomes like blatantly obvious that we're actually in this colossal capital misallocation problem where we're putting all of our capital in the one type of AI that has the absolute worst trade offs, and we should be rapidly urgently shifting that capital to all of the other types

of AI that have the correct trade offs very little cost for maximal benefit.

Speaker 1

The question of scale, or the idea or the obsession with scale, I guess you describe as a doctrine in Silicon Valley and in these companies that the only way to do this, as you're just referencing, is to scale as big and as fast as possible, And something I see a lot in headlines these days is in press releases is talk of hyper scaling and mega campuses and all of this stuff, which is obviously touted is a

good thing. When you see hyper scale and mega campus and where bigger is better, so we must be doing something revolutionary and profitable. But it seems like the biggest certainly from an environmental perspective, the biggest costs come from the scale.

Speaker 3

Right.

Speaker 1

It's not necessarily the technology itself, but the size at which that they are obsessed with doing this stuff.

Speaker 2

Is that?

Speaker 1

Is that right?

Speaker 3

Yeah? Exactly. That is my fundamental critique about silicon valleys a Perrhai. They've created this idea that you can no longer challenge within the valley, that in order to reach some kind of utopic state through the creation of AGI, you just have to pour ever more data into these models and train them on ever larger supercomputers. And we

are now talking about supercomputers the size of Manhaeian. Meta and Opening Eye have both drafted plans to build supercommuters the size of and that consume the same power demands as Manhaian. This is not actually scientifically sound, you know, like when I had the privileges of starting to cover AI research. Before chat GBT came out, and well before large language models became the obsession, AI research was actually

heading in the exact opposite direction. At the time. People were looking to build smaller and smaller models, and it was all about tiny AI because they were all of these different techniques that researchers were experimenting with that found that you can build really powerful AI systems with minimal amounts of data, and also on pocket like a phone, like your pocket computer, and that kind of understanding that we can actually create new algorithms, create new training techniques,

just redesign AI systems from the ground up to use lesson less resources, something that's been totally thrown out the window by Silicon Valley. And it does not make sense to me why we have got and stuck in Well, I mean it does because some of the people, the people that are putting us on this map have an extraordinary out of capital, extraordinary out of narrative power and

so on. But yeah, it's not scientifically technically justified, and it has gotten us into this absolutely twisted state where we are burning down the earth in order to do something that's wholly unnecessary.

Speaker 1

And I keep coming back to the psychology and the worldview of the people making these decisions, because talking about social, environmental, political, cultural trends, you know, we often talk for good reason about problems that are systemic and structural rather than individual. But I feel like this is one of those cases where it is all of those things, but it's also very individual in the sense that so few people are making these decisions that are impacting so many of us.

And I'm just wondering, because you've spent so much time with folks at you know, current former employees at open Ai as well as the other companies, and there's obviously a lot of churn between them, Like, how much do you think this trajectory that we're on from you know, pocket sized ai have a decade ago to Manhattan sized

supercomputers potentially in the near future. How much of that do you think is driven by just individual desire for wealth and more specifically power and domination, versus actually wanting to believing in their hearts that these technologies will solve the problems that they claim to be able to solve. I'm just wondering how you think about the psychology at play there and how much of our future is being dictated by a really small number of people's desire for domination over the rest of us.

Speaker 3

Yeah, I think the best way to answer this question is, I think in order to be one of these people, you have to be self delusional, and so I'm sure that they believe that they believe that they're doing this

because of out of goodness. I don't think you can sustain waking up every morning and orchestrating these deals and decisions that are terraforming her than reshaping geopolitics and rewiring everything in these ways without deluding yourself into believing that you are on a mission for the benefit of all of humanity. And I think that is that was not something I fully understood until I reported my book and

spoke with so many people in this world. Was I did think that there was more distance between the rhetoric that they used publicly to leverage whatever public opinion or their political capital or narratives to get what they wanted and their actual true beliefs. And what I realized the more that I reported is actually the rhetoric and what

they believe. The distance collapses over time because you just cannot continue to say all of these things and do all of these things without giving telling yourself that that is true, that is your truth. People's beliefs become molded by what they need to accumulate more power and you accumulate more wealth. You know, I had the because I started reporting on Opening Eye several years before chat Gibt

came out. Like, I interviewed people back then that I've been and reinterviewed for the book, So I sort of have seen people transition in their beliefs over time as they've become more and more part of the company and this world, and it really does completely transform them and who they think they are and what their worldviews are.

Like I was talking to people back then who were like, I don't really believe in the AGI think, but you know, I just get I get a good salary, I get a lot of resources to play around with cutting edge research.

It's basically like working in academia. But just like way better funded through have then now become complete AGI believers, like do not even question for a second that they are building something that could be akin to a god and will have utopic qualities, and that this is the reason that they're brought to this earth.

Speaker 1

I'm sure it's intoxicating to feel that. I can see how people might get addicted to that feeling of being on some sort of divine mission.

Speaker 3

Yeah, absolutely, and not just a divine mission, Like people have to get addicted to just the sheer. They get addicted to a lot of things. They get addicted to the sheer size of the resources that they can have access to. They get addicted to the amount of influence that they can have. You know, like I've had people say to me, well, there's really very few other companies that you can work to have ripple effects on billions of people around the world. And for them, that is

They're not saying that in a machi Abelian way. They're saying that in a I want to change the world to be a better place, So what better leverage can I get than being at a company that touches billions of people's lives, Like they're saying it from a place of this is, how could you not let take that opportunity? If you, like, if you wanted to change the world and you stepped into my shoes, wouldn't you do the same thing.

Speaker 1

It's really unsettling to think about.

Speaker 3

Yeah, it's it totally the realization that the self delusion is that strong. Breading the book really made me feel a lot more freaked out about Yeah, like where we where we could be heading if we don't as a society rise up to contain the empire of AI.

Speaker 1

Yeah, I mean, it just shows why empire is really the perfect description for what is happening. Was there a point when you were reporting the book or when you were writing it, when that became clear to you that this was the project they were undertaking, was the construction of not just a company or a conglomerate, but an empire.

Speaker 3

So interestingly, I actually when I first started working on this book, it had very little to do with OPENINGI and only to do with the AI industry as an empire. And the reason is because I had been working on a project called AI Colonialism for MIT Technology Review just a year before Chatbut came out, and I had already been thinking about the parallels between the colonialism and the way that the AI industry was operating around the world.

And this was based in part on me reading a bunch of scholarship that I identified these parallels and then growing really fascinated by it and looking to see whether or not that was actually happening the real world and traveling to different countries to document those parallels and finding

extremely striking parallels in the process. And so I'd originally cold see that the book is just let me just write more about that, about the argument that there is something very neo colonial happening here with silicon values push to build and deploy this technology. And then when chat GBT came out, my agent was actually the one that said, well, how does this change things? Do you think that's fixed

the problems? And I was like, no, it's made it way worse, like orders of magnitude worse, because now they've fired the first shot where every single company is now going to go after scale the way that Opening Eye has religiously done, which was not at all the norm before then, and that's going to accelerate the resource extraction, accelerate the labor exploitation, accelerate the environmental degradation, and in all of the ways that I was already seeing those

parallels to the Empire, and so yeah, so the revelation went the other way around. It was starting with Empire and then realizing that Open AI was the center of so much of this story. Rather than starting with Open AI and then realizing they were an empire.

Speaker 1

Something you point out throughout the book is the way that open AI kind of sets the precedent for the way the rest of the industry goes, certainly like the obsessional scale as you mentioned. Another one is the kind of rapid evolution or devolution from these being essentially research hubs doing peer reviewed research. And yes they're funded by private industry, but everything's very open, very academic, lots of collaboration with universities and scholars, to in another parallel to

the fossil fuel industry, very secretive. They have the information about what these things do as best as anyone does, but they're not publishing it, they're not sharing it. Critical research gets suffocated, people get fired for criticizing the regime.

Do you talk about the kind of the suppression of inconvenient information and how fast that that shift occurred from we're essentially you know, private research hubs to this is proprietary information and you know, do not deviate from the narrative.

Speaker 3

Yeah. So I think people who start becoming aware of the air industry and as practice post Chatjubut would think it's perfectly normal that these companies are very secretive about their quote unquote intellectual property, and any kind of AI research would be considered intellectual property, and therefore it's not weird to them that these companies are are typefisted about that kind of information and not transparent For people who knew what the norms were in AI research before chat GBT,

this is a dramatic one eighty shift. Before even though much of the tech innutry was bankrolling AI research, the understanding was that in order to be competitive in attracting talent you had to entice AI researchers by promising them that they would ultimately get to publish all of their

work in public. Because AI research was still very academically driven, and so even within it, even if you were a Google researcher or a Meta researcher or whatever, your street cred was still based on how many papers are you publishing in top publications, how many citations are they getting. It was just like the credentialing was just very very

academically coded. I guess you could say Opening Eye. Not only did they close themselves off in a great irony to their name, they closed the entire industry off by doing a lot of work early on to see this idea that maybe opening up a lot of this AI research could be dangerous, and therefore it was actually the responsible thing to shutter this research so that quote unquote

bad actors could not get access to it. And that created a cascading effect across the industry where suddenly when it became clear to companies that they could still retain the top researchers and be competitive in the talent race while being closed off, then it became sort of like dead obvious to all of them that was the best business decision is you want to keep your competitive advantage

close to your chest and not share that information. And so what we've seen happen is very quickly, because structurally most AIR researchers were ready employed by big tech, Suddenly the majority of the research discipline now becomes distorted based on what companies think is appropriate or not appropriate for the public to know. And so it's not actually a

science anymore. I mean, it's just pr And we have an absolute, completely inaccurate understanding now of what the true capabilities and limitations of these AI systems really are because you cannot audit what these companies claim the ANA systems can do without any of the transparency on how they were built, what data were they trained on, what kind of tests are being run on them, what contexts have they been stress tested in, and so on.

Speaker 1

And that's true for some of the environmental impacts and carbon emissions too, right, it's hard to understand the true impact without them revealing some of this information.

Speaker 3

Yeah, exactly. So we don't know how much energy it takes to train a model, I mean, And of course there are open source models, and there's been plenty of well, I shouldn't say plenty, there has been some really fantastic research on using open source models as a proxy for understanding the energy and environmental impacts of training these large

SCALEI systems. But we only know what the real impacts of the commercial closed source systems are when companies deem it okay to release that information, which has been very rare but has happened when they've come under extreme public pressure to do so.

Speaker 2

So.

Speaker 3

Google has over time slowly dribbled out some information about the environmental impacts of its models, and Meta has tried to also do a little bit of that to try and generate some like good pr around their transparency and trying to position themselves as sort of like an open source leader, but it is so limited and the transparency is completely disproportional to what is actually needed based on the size of the environmental impact and energy consumption.

Speaker 1

There's something that you noted at some point in the book you made the what When I read it, it seemed very obvious, but I hadn't thought about it at all, The point that to solve a global challenge like the climate crisis whatever, again, whatever solve means well, we'll also need more social cohesion and global cooperation, and of course that is precisely what these empires are undermining. I guess I had been thinking about it, you know, as the way they wanted me to think about it in some ways,

as a technology. Could you just unpack that a little bit, the way that these empires are undermining the very cohesion in cooperation that you would need to actually make progress.

Speaker 3

Yeah, this is something that I have has been sort of a revolution that I've had again and again and again and reporting on technology, is that so often as a society we are vulnerable to believing that technology will solve social problems, and actually only social solutions will solve social problems. And ultimately, climate change at this point is not a technology problem. In fact, we have an abundance of solutions that we could be deploying, and it's just

a lack of political will. It's a lack of global cooperation, a lack of all of these soft skills that have caused us to fail at actually getting there. There's this organization called Climate Change AI that I really love. It's a nonprofit that was set up by a bunch of AI researchers around the world to think deeply about what is how do we actually what can AI actually do

to try and mitigate climate change? And they document this long list in a white paper of all of these different computational challenges because ultimately, like AI is a computational

technology that lends itself to computational challenges. So it documents all these computational challenges that could be helpful for solving when it comes to climate change medication, like integrating more renewable energy into the grid, more accurate weather prediction, more accurate climate disaster prediction, reducing the energy demands of buildings

and cities. And then in the white paper it says, ultimately, it's not just these things, these technologies that are going to get us there because these technolog like they list all the AI tech techniques that they list have absolutely nothing to do with large scale AI generative AI systems. They're all techniques that have been around for basically a decade. And they were like, that is evidence enough to show you that it's not actually a technical problem at the

end of the day. And so that was kind of what I was getting at in that line, is like, these companies are creating AI systems currently that are straining resources, which heats up geopolitical competition over those resources. They are perpetuating an arms race narrative that also erodes the willingness

of different geopolitical powers to cooperate with one another. They are creating machines of misinformation and disinformation that's eroding the fabric of trust in various societies that is also the

building block for cohesion and cooperation. And so they're kind of basically like, when you start to realize it that client change isn't really a technology problem and it is a social problem, all of the things that we need to fortify are actually being chipped away at maybe not chipped away, like halfed away by the industry with the current systems that they're building.

Speaker 1

There's a very hopeful point that you make in a couple of places throughout the book, which is that despite the power that these empires have, they're not entirely invulnerable. Could you share one of the stories of some of the communities that have successfully fought back. I was particularly moved by the way, you know, in response to some of these companies trying to come into communities in Chile

or elsewhere. Yeah, under the secrecy of shell companies trying to sneak in a massive data center that's going to use up all the water in an already drought stricken part of the world. People see what's going on, and they mobilize, and they have had some really inspiring successes.

Speaker 3

Yeah. So one reason I also think the empire analogy is extremely pertinent is because empires are made to feel inevitable, and yet they've always fallen in history, and it's because

their foundations are extremely weak. You cannot actually ultimately sustain this degree of extractivism and exploitation has such a large scale without people revolting, And that is what I document happening in Chile, where Chile has a very long history of extractivism and being a concept that came out of decolonial scholars from Latin America talking about the harvesting of their resources for the benefit of people far away rather

than the local community. And they essentially see the AI industry and all the data centers and the mining that the industry is doing to try and build these colossal silicon monstrosities as just an extension of this history, like yet again, we are dealing with a greedy industry trying to extract at scale our precious earth. And so they immediately became activated when they discovered that this was happening, and I spoke with these activists in this community right

on the outskirts of Santiago called Serrijos. That was they learned that Google was trying to build a data center in the one town that actually has access to a

public drinking water source. Because in Chile, due to its history of dictatorship, most things were privatized, including water, but the one municipality that had a free public drinking water resource was the municipality that Google then was like, yep, We're going to put our data center in there and then tap into this freshwater resource and use tool our facilities, and this community lit up and was like absolutely not.

These activists started knocking on all of the neighbors doors, posting flyers, creating you like memes and art, political art and all this stuff to educate their neighbors that this project is not at all going to benefit our community and is in fact taking the one extremely precious resource that we have to your point in a drought stricken time. And they made so much noise that escalated all the way to both Google's had quarters in Mountain View and

to the national Chilean government. And basically after this extraordinary pressure where they've stalled this project for five years, the Chilean government has now created a roundtable for consulting residents and environmental activists on their data center plans and putting

them in conversation with companies like Google and Microsoft. It's not a perfect solution, and that the activists have said, the moment that they blank, everything can fall apart, and so they have to continue being vigilant, they have to

continue protesting, resisting being on the streets. But it is a remarkable step that they got the government to make to even bring them to the table, and is just a lesson to be learned by everyone around the world that if you remember that you actually still have agency, you can absolutely shape the trajectory of AI development by loudly, forcefully making that kind of trouble when these companies are engaging in this imperial activity.

Speaker 1

So such a good note to end on. Thanks so much for this conversation, Karen, and for what is truly such an important piece of work in scholarship. So I am grateful for the enormous amount of time that went into it.

Speaker 3

Thank you so much for having me Adam.

Speaker 2

Drilled is an original Critical Frequency production. This episode was reported and written by Adam Lowenstein and produced by Peter duff. Artwork for Drill is by Matt Fleming, fact checking by Naomi barr Our. First Amendment attorney is James Wheaton with the First Amendment project. Drilled is distributed by Pushkin Industries. Huge thanks to the team there, including Greta Cohen, Eric Sandler, Grease, Ross, Morgan Rattner, Owen Miller, Kira Posey, Jordan McMillan, Brian Schreberneck,

and Jake Flanagan. You can find a written version of this interview and lots of other author interviews, stories, and all kinds of content on our website at drilled dot media. You can also sign up for our newsletter there and follow us on all the social media sites at drilled media. Thanks for listening and we'll see you next time.

Transcript source: Provided by creator in RSS feed: download file
For the best experience, listen in Metacast app for iOS or Android