Imagine that one of these centuries we make contact with an alien civilization.
It's a big.
Cosmos with quintillions of planets, so it's bound to happen at some point. But how the heck are we going to understand what they're saying? How are we going to decode their language? After all, they might not communicate with air compression waves. Maybe they do something visual, but in ranges of light we can't even pick up with our eyes. We won't have a Rosetta stone, So how are we going to decipher what they are trying to say to us?
And this might seem speculative, but what I want to draw our attention to is that we currently are in the same position right now, right here at home, which is that we can't tell what a single one of the two million species on our planet are saying, not even the six six hundred species of mammals, which are presumably kind of like us. We're not having conversations with anyone but ourselves. With all these species, I'm willing to bet you don't listen to a single podcast not.
Made by a human.
But today we're going to see some hope, some pathways for how we might get to animal translation and relatively soon. Welcome to Inner Cosmos with me David Eagleman. I'm a neuroscientist and an author at Stanford and in these episodes I examined the intersection of science and our lives, and
today we're going to talk about understanding animals. When I was a kid, I saw some episodes of Star Trek, the original one with Kirk and Spock, and the thing that always struck me was how every week on schedule they discovered new alien civilizations, which is not so crazy
given that the universe is presumably teeming with life. There are about one hundred billion galaxies, and each of these has about one hundred billion stars, and most stars have some planets rolling around them, so it's extraordinarily unlikely that we are the only planet with life on it. But before I get into alien communication, let's quickly address something first. You've probably heard of the Fermi paradox, and if you haven't,
it's a very important question. It's the question of why, if there's all this life in the cosmos, why have we not heard a peep from anyone. This paradox is named after the physicist Enrico Fermi, who raised this question if there are so many potential alien civilizations, why haven't
we detected any signals or encountered any of them. Yet we're living in a moment of history where there seems to be this very strange contradiction between the high probability of extraterrestrial civilizations and the lack of any shred of evidence for them. So over the decades, people have proposed all kinds of possible explanations for the Fermi paradox. The first is that maybe aliens don't exist, which is the simplest explanation but presumably not terribly likely given the size
of the cosmos. So some people point out that maybe the problem just has to do with the enormous distances, the vastness of space, and the limitations of our current technology that might make it hard to detect other civilizations even if they exist, because the distances between stars are enormous and signals may take thousands or millions of years
to reach us. Okay, so that's a possibility. Or A related idea is what's called the rare Earth hypothesis, which is that Earth like planets, which are capable of supporting complex life, are exceedingly uncommon in the universe, and that makes the emergence of intelligent civilizations a rare event. But again, given that there are something like seventy quintillion planets, that's a seven followed by nineteen zeros Earth like planets can't
be too rare. So another idea is the technological singularity idea. Some thinkers have proposed that advanced civilizations might always end up reaching a technological singularity when their technology suddenly accelerates rapidly, and one possible outcome of this is that these civilizations tend to self destruct, and a related hypothesis is that when other civilizations hit this singularity, this leads them to
a post biological existence. They're no longer products of nature, but instead they build themselves into other sorts of devices, which would be hard for us to detect given the ways that we're searching. And other people suggest that advanced civilizations intentionally avoid broadcasting their signals or their presence for fear of attracting unwanted attention or causing conflicts with less advanced civilizations. Or maybe they're just not interested in contacting us.
They might be too busy with their own problems, or they simply don't see us as an interesting threat or ally, so there's no reason to pick up the phone. And then there's the possibility that they use extremely different communication methods than we do, so different that we can't currently understand them.
Or even know what we should be looking for.
So ultimately we don't know why we haven't heard from anyone yet. There may be other reasons, or maybe multiple of the reasons I mentioned, or all at play, but for now we just have to live with the fact that we haven't yet heard from anyone. So this was part of the appeal of Star Trek. Every week there spacewarping off to some new coordinates, and.
Everywhere they go they meet new civilizations.
Now, the thing that always struck me as funny and the point of this episode is that each week they end up meeting these new aliens. And often these aliens look like a female movie star in a cool jumpsuit, but with subtle differences like pointy ears and green skin. But the key thing is that all these aliens speak English.
Usually it's a slightly broken English with a difficult to discern accent, but nonetheless pretty easily understandable, which is of course very lucky for these Star warsvoyagers who happen in several hundred years from now to speak English themselves. Now, why did the writers of Star Trek choose to make everyone speak just like we do?
Well?
This is a basic constraint of storytelling. It's the only thing that will work for telling a narrative that people will tune into. It's hard to tell a story if the alien is some kind of weird fungus thing that doesn't speak or lives at a different timescale than we do, like a tree. If we land on a planet of mute, slow fungus creatures, it's not going to make good television. So the stories we tell will always have aliens that we can talk with and that serve as not so
distant reflections of ourselves. Okay, so no problem, that's what storytelling requires. But in real life, it's much more likely that we're going to have a very very difficult time communicating much of anything to aliens when we find them. You might think that we can get by with something like take me to your leader or some sort of hand signals, but in fact none of that's going to work. Now, what's the reason that I say this? Why should we
think that communication is going to be so difficult. Well, the aliens we find on other planets are going to have a totally different evolutionary history. They may not be based on DNA like all earthly creatures are, but instead may have found a completely different way of encoding information
and managing replication and building societies. And it's possible they won't even be carbon based like all creatures on Earth are, but instead based on something like the element silicon, which also has a tetrahedral structure and can make lots of
useful elements and so on. So there's a whole field of this called astrobiology, where astro refers to star and often known as exobiology, where exo means outside, and the idea with this area of study is to search for naturally evolved life in the universe, mostly on other planets in the habitable zone, that's the Goldilocks zone of planets who rotated just the right distance from their star so
it's not too hot not too cold. I'll also mention there's a closely related field called zenobiology, which means alien or foreign biology, and that term is usually reserved to refer to biology that is synthetic, not found in nature that science has no clue about yet. The general idea is that astrobiologists try to detect and eventually analyze life elsewhere in the universe, while xenobiologists will attempt to design forms of life with a totally different biochemistry or different
genetic code than on planet Earth. Now, when we search for life in the universe, I don't really see any reason to imagine a distinction between naturally evolved life on other planets and synthetic forms of life, because a planet ten thousand years ahead of us would be well on its way to building other species in the same way that our species existence might simply serve as the spark to build an artificial species that colonizes the Solar System.
And so for this reason we should always be thinking about new biologies, new animals that could use a completely different kind of biochemistry. On this planet, all we've ever seen for coding information is DNA and RNA. We have twenty amino acids from which we build all our proteins, which are like little molecular machines. But instead of DNA, we might find elsewhere what we'll call XNA zeno nucleic acid.
You might find a massively expanded genetic coat that uses other amino acids to build totally new kinds of proteins, or perhaps most likely, you could have something that's not like our genetic code at all. Something to considers that we only discovered the genetic code in nineteen fifty three, which is not that long ago. I actually worked with Francis Criek, the code discoverer of the structure of DNA, So this is massively recent and we don't know what
we haven't thought of yet. So for this reason, I think of the whole endeavor of space biology as zenobiology, thinking about and looking for ways that life could be built that we haven't yet imagined yet. And by the way, it's thought exercises like this that make me wish I could see the text books that our descendants will read five hundred years from now or one thousand years from now. There's going to be so much known that we currently can't imagine. That's totally in our dark zone. Things we
have I haven't even realized that we don't know. Okay, So all of this is to say life might be massively different than what we have here on Earth, and the question is will we figure out how to be like Captain Kirk and beam onto their planet and have a conversation with them.
Now, maybe all this talk.
About extraterrestrials seems abstract because we haven't discovered any yet. But I want to point out that we are surrounded by aliens. They are all around us, and they're making constant sounds. We have measured this alien language with our recorders, and at the moment we have no idea what they're saying.
Now, that's the.
Sound of whales on our planet, and lots of animals make noise, And the question is, are these animals that we're surrounded.
With speaking a language.
These are the aliens that we don't have to travel very far to listen to, And the question is can we understand them?
So maybe so, maybe not?
After all, these sounds could be like belches or like grunting, the way you do when you're home alone and you bang your knee the night before and you're going up the stairs and you make a sound, but it's not really meant for anyone in particular.
It's just a noise that you're making.
So how would we know if animals are actually implementing language and communicating meaning to one another. Well, this is an unanswered question right now, and it probably differs species by species. One thing biologists look at to try to address this is things like turn taking. Does one animal make some sound and then the other animal goes, and then the first one again, and then the second. That feels more like language, right something had said, there's some response.
It feels like there's at least the possibility for some real meaningful conversations that way. But there are a lot of questions here. Even if we found that some species were speaking language, would we be able to understand the meaning? And I don't mean this in terms of this call means this thing, but in terms of what does that
thing mean for a human? Imagine if a bee is talking about some experience that you really have to see in ultraviolet to understand, or your dog is experiencing something about smell that we couldn't possibly get from our experience, or a dolphin is talking about the joy of that moment where there's no more little fish, and so the whole pod suddenly turns upward and rockets through their world
and breaks through some surface where everything is different. Might it be the case that there's simply no way we could totally understand what they mean. There may be things we can identify that they are talking about, but I think there's a spectrum of how close we would actually be in our interpretation. And by the way, I'll just note this is true with our fellow humans as well.
Someone might tell you about an experience with hang gliding or stamp collecting, or psychedelic drugs or whatever, and even though you gnawd and you say, oh, I gotcha, I can relate that to my own experience. There's a spectrum of how closely you are actually capturing what they are describing. Sometimes you might have an analogous experience that puts you close,
and sometimes your assumptions may be pretty distant. So back to animals, how much could we even understand in a translation, given that animals have such different sensory windows on the world, and so their concepts might be very different from ours. Now, even with all these caveats, how amazing would it be if we could get even a low dimensional, blurry glimpse of what they were talking about. People have always wanted
to understand animals, and they've tried in the past. But we are at an amazing moment in history where I think the time is right around the corner. And I'm not saying this is a general claim. I'm saying this for two specific reasons. First, we have incredible technology now which makes it possible to do biologging. What is biologging. This is about collecting data from an animal with a small, lightweight device.
These are called biologgers.
You hook these up to an animal and that way you can collect data for long windows of time without humans being around. You can record sounds, and measure physiology and track movements, and this is how you get a secret window into an animal's world. Any thing is that it gives new, rich data that you just can't get otherwise about animals in their natural environment. Now, it's not always easy to attach to the biologgers to animals, especially
if they're small and fast. But the main problem is that the data collected by the biologgers can be really complicated and difficult to analyze. So we humans have amassed a ton of rich data that we're sitting on. And that leads to the second specific reason why we're just on the verge of something amazing, and that's artificial intelligence. AI has been used for years to translate and decode human languages, and now we have this incredible opportunity to
leverage it for understanding animal communication. And I'm lucky enough to be friends with one of the people at the lead of the effort to decrypt these alien languages that were surrounded with So how does our modern technology give us hope for decoding animal language.
So the insight originally came in twenty thirteen when I was listening actually to NPR and there was a researcher describing to a lot of monkeys.
That's Asa Raskin. He's a writer and entrepreneur and inventor, and for the purposes of today, he founded the Earth Species Project ESP, which is a nonprofit focused on using AI to decode non human communication.
And these animals are They're credible. They live in the Ethiopian highlands. They have like huge maines, red patches on their chests. And what I did realize is that, according to the researcher, they had one of the largest vocabularies of any primate except for US humans. In fact, the researchers swear that these animals talk about them behind their back. And so the thought back then was like, well, if
people are just out there. The researchers are just out there trying to understand what these beings are saying using like a hand recorder in hand transcribing. Couldn't there be a better way? Couldn't we use like machine learning AI large scale microphone arrays. But of course, in twenty seventeen, that wasn't yet possible because machine learning couldn't do something that human beings couldn't already do. They couldn't translate a
language without a Rosetta stone, without any examples. And that really changed in twenty seventeen when the machine learning community there were two papers that came up back to back and the Way this Thing Happens, that showed that you could translate between any two human languages without the need
for examples or Rosetta stones. And I can dive into how that works, but that was the moment that we said we should get going and along the journey, I just should say, like, all right, is there even a there there? Like we say animal language, What does that mean? What is a rich complex communication structure? What would that look like? I just want to give a couple examples
for your listeners. So off the coast of Norway, every year there's a group of false killer whales that all phenomenologically speak one way, and a group of dolphins that all speak another way, and they come together and they hunt in a superpod. And when they do this, they speak a third different way, which is just sort of crazy, right like. And it turns out that whales, you know,
have a culture extending back thirty four million years. They have dialects that sort of split off, which they can understand each other with, and that can split all the way into mutually unintelligible languages. Another example is I learned this in twenty fourteen that for campell monkeys, hawk for them means eagle, crack means leopard, and hawk ooh means predator that's up, crack ooh means predator that's down. So
now we have a simple syntax. And then one of my favorite studies is from the University of Hawaii in nineteen ninety four, and here they taught dolphins two gestures, and the first gesture was do something you've never done before, which is sort of a crazy thing to be able to communicate, but the dolphins will do it. And to remember to do that, that means they have to remember every single thing they've done before that session, understand the
concept negation not one of those things. Then invent whole cloth, some new thing that they've never done before, but they can do it. And then they'll teach the dolphins a second gesture, do something you haven't done before. Together, and they'll say, at the same time, do something you haven't done before. Together. The dolphins go down, exchange sawnic information, come up and do the same trick they've never done before at the same time. And while that doesn't prove
representational language, it certainly places I think Auckham's razor. On the other foot, it certainly seems that way. How do you know, though, when you're approaching these that there exists languages? For example, you said that whale culture or civilization is thirty four million years old, But how do we know that they're speaking a language that has the kind of structure that we have that is capable of passing on a culture or civilization. Yeah, great question, And of course
it's hard if you can't listen in and understand. But you know, there are two hallmarks of language that human beings have, one of which is to be able to talk about something that isn't here and something that isn't now, can you refer to things that are in a different time, in a different place. And we can actually see already from the research that the answer is. It appears to be the case that at least some animals can do this.
So Adrian Lumero is a researcher on great apes, and he's discovered in the last year or so that are tangs do have a version of a past tense. They can talk about things that are not now. And then dolphins have names that they called each other by, and Ian Yannick in twenty sixteen discovered that they will use those names in the third person. They can talk about one of their own that is not here. So now
we have two of the hallmarks not here not now. Now, when we say language, we only have one example of a species that speaks what we call language humans and almost always like if you only know one color and then you learn a second color, you discover an entire rainbow in between. Like when we say language, you know we're using that to be a catch all for rich communication systems that can pass on cultural information.
Yeah, agreed.
Let me jump back to the orangutans for one second. Is there any evidence that they have future tents.
That's a great question. We do not know. That's what's so exciting about this field right now, is I think of this it's sort of like the invention of the Hubble telescope, right, It's like, and if you remember, I think it was back in nineteen ninety five they pointed the Hubble telescope and an empty patch in sky and what they discovered was the most galaxies that have ever
existed in one spot. That's essentially what we're discovering here is that we just haven't had the tools to look and when we do, what we're discovering is much more than everything we discovered. What we're discovering is everything.
Yeah, exactly right, the deep field experiment. So how do we actually do it? How do we apply all the modern tools of science to see if we can decode a language?
Yeah?
Great question. So I'm going to start with this twenty seventeen technology, and I just want your audience to remember that twenty seventeen is essentially the Stone Age in AI. But I think it's a really useful conceptual tool to understand how it might work. So, how do you translate between languages that don't have Rosetta stones. And it turns out what you can ask AI to do is build a shape that represents a language. So you say, feed in all of Wikipedia, a whole bunch of text, and
the AI generates a shape that represents a language. Imagine a galaxy where every star is a word, and words that mean similar things are placed near each other, and then words that share a sort of conceptual relationship get turned into sharing a geometric relationship. What does that mean? That means if you imagine king is to man as woman is to queen, then in this shape, king is the same distance direction to man as woman is to queen. And so you actually just subtract king minus man. That
gives you a distance of direction. You add that to boy and that'll equal prince. You add that to girl eqal princess. You add that to woman and equal queen. And so if you think about all of the relationships, the internal relationships of a language, they think about the word dog. Dog has relationship to man and to howl
and to wolf and to fer. If you it sort of fixes in a point in space, and if you solve this massive multi dimensional Sudoku puzzle of how every concept relates to every other concept that gets turned into a geometry, and out pops a rigid structure that represents a language. Now the computer doesn't know what anything it means. It just knows how they all relate to each other. The shape represents all of the internal relationships of a language, which is of course just a model of the world.
All right, So you have this shape for English, and this is what the machine learners asked in twenty seventeen. Is it possible? They said that the shape which is English might be similar to or the same as, the shape which is German. And if you ask anthropologists, they'd be like, no, that's a silly thing to think, like. They have different ways of viewing the world, different cosmologies. But the machine is like, whatever, let's give it a try.
And it turns out that it works. You can take the shape which is English and the shape which is German, and literally rotate one shape on top of the other. And even though there are words in one language that don't appear in the other, if you blew your eyes, the shapes are roughly the same, and the point, which is dog ends up in the same in both. Now you might be saying okay, but that's because English and
German are very similar languages. But it turns out this works for Finnish, which is a really weird language, Turkish, Aramaic, Urdu. Pretty much every human language fits in a kind of universal human meaning shape, and the point, which is dog ends up in the same spot in all of them, and this lets you do translation without the need for any examples. And this is I think, such a beautiful, profound realization that there is a hidden structure underlying all
of us that unites our way of seeing. So that was the sort of the core insight that said, well, maybe now it's time to start building that shape for animal communication, which by the way, is very hard because it takes denoising and working with many partners to collect like the years with the data that's required. But that's sort of what we started to do. Now I'll pausit for a second, but there are a couple other techniques that can add to the top of this.
Great so let me jump in for one second. So the fact that all the human languages have a similar structure to them is in part because humans radiated out of Africa sort of yesterday and as a result, you know, we all have the same brain and it's not so surprising.
And the question is what do we expect when we're looking at animal languages, which I'll come back to some more questions on that a second, But what do we expect in terms of the similarity there given that animals are picking up on different signals from the world they're umvelt is different the signals they can get and their concepts might be very different.
How do you think about that?
This is a great question. It's just to repeat what you're saying, is that the censorium, the way that animals perceive the world, like what it is like to be a bat, may be so completely different than what it is like to be a human because they're seeing in three D sound that we can never translate anything. And that may turn out to be the case, but you know, I think there's reason to believe that there may be some kind of overlap with our experience. And to just
give a couple examples. You know, lemurs, for example, are known to bite down on centipedes, literally to take a hit off of centipedes to get high. They enter this very trance like state, they get super cuddly. It looks sort of like a scene from Burning Man. Dolphins too, are known to intentionally inflate pufferfish to get high after their venom and then pass them around literally puff pass. Great apes are known to like hang off of vines
and spin to get dizzy. There is something about a transcendent state of conscious altering our state that is at least shared amongst the mammals, and so if they're communicating, they may well communicate about that, and that's something we'd share. Another example is something known as the mirror test. This is a test where you take an animal, you paint a dot on them where they can't see it. You
give them a mirror. They look in the mirror, they see the dot, and they turn to the dot and they try to brush it off of themselves or investigate it. And in order for an animal to do that, they have to associate the image that's in the mirror with themselves. They have to look in the mirror and say like that's me. So that means there's a rich sense of interiority, like a self awareness. Dolphins past this test, elephants past the tests. A number of other species pass this test.
So even the concept so profound as me self awareness that seems to be shared. You know, examples of people showing orangutangs magic tricks and they go crazy. It's worth just looking them up on YouTube to see these kinds of videos. Pilot whales carry they're dead young for three four weeks, like grief is a shared part of the experience.
So if you imagine these shapes, where one of the shapes is like human language, is one of these is animal communication, I think we should expect to see some part of those shapes overlap, and that should be the part we should do direct translation. But then there's going to be a huge portion of the shape that can never be directly translated to human experience, and you'd sort of expect that to be sticking out, like where we can see complexity, but we don't know how to translate it.
And I still don't know which one of these two is going to be more fascinating, the part where we can directly translate the part we don't, because, as I'm saying, human beings have been communicating vocally for one hundred thousand to three hundred thousand years, passing up culture. Whales and dolphins have been doing this for thirty four million years, and that which is oldest correlates with that which is wisest.
So for something to survive thirty four million years, there has to be some deep kernel of adaptive truth in there. And whatever it is that is the solution to humanities problems, like, it's not in our imagination, because if it is, we'd probably be trying to do it. So this is a way of starting to get the first polaroid sort of blurry image pictures of that which is beyond our imagination.
Now, let me ask you this. If we're just looking at the auditory.
Information that we get from animals, we can do this kind of technique where we're looking to match one galaxy of stars to the other galaxy of stars and see what parts are sticking out and so on. But we may well need much more than just the audio right to understand the context of what the animal is saying in a particular situation. So how are people pursuing that?
That's a great question. Even for humans, we know that so much of the information that we convey. If you've ever had to try to order food in a country where you don't speak the language and somehow you can do it, you can have communication without words the same thing may be true for animals. So in fact, chimpanzees are known to have sixty plus hand and feet gestures, which seems to be at least as far as we know, their predominant form of more symbolic communication.
Plus, we have indefinite references to things all the time, right, So when I say she, I might be talking about Marie Curie, or I might be talking about Michelle Obama or something. But once I've introduced too I'm talking about I can just use the word she. But somebody trying to decode when I'm saying who doesn't speak English might have a hard time understanding what the references to.
Yeah, that's exactly right, and what you're speaking to is the importance of context. In order to understand what someone is saying or what an animal is meaning, we have to understand the context. Otherwise, like the same grunt may mean like that monkey, or it may mean like I'm upset, and it all sort of depends on social context. So a lot of what we do now is multi mode.
That is to say, we work with biologists that have tags on animals, that record often video, audio, and motion, and that lets us begin to translate between all of these different modalities, and in fact, with some of the species to work with, these tags are on multiple animals in the same group, so we can get social context. And I want to return for a second to this
really interesting question you pose. You're like, well, maybe all human languages fit in the same shape because we share the same physical substrate, the same brains, in the same ears, and the same eyes. But there's something deeper going on in machine learning than just the ability to match the shapes of languages. Maybe your audience has heard of or seeing Dolly or mid journey or image diffusion where you type in text and outcomes an image that is never
been seen before. How does that work? Well, these shapes are actually really helpful to have in your mind to understand how it works. So let's build now a shape on human faces, and once again you end up with a galaxy where every star now isn't a word, but is a human face. Faces that share similar relationships share
geometric relationships. So if I take a picture of your face, David, and then I take a picture of your face that's smiling, there's this distance in direction that takes me between your face and your faces just smiling. I subtract those two as I get smilingness as a relationship. I can now add that to any other face in the shape and I'll get the smiling version of that face.
Right.
So now there's a direction that represents smiling, there's a direction that represents frowning, that represents age, that represents gender, more male, more female. You end up with a map of all the semantic relationships, and you can now do that not just for faces, you can do that for all of images. And now you have a shape that are presents images, a shape that represents languages. You look at image caption pairs on the Internet and you can align these two shapes. So now you have a way
of translating between text, language and images. So now you just type in something like image I don't know, like portrait of the country Chile as a woman. It goes into the language space, gets translated to the image space, the computer generates the image that's there, and you get that. So that's how that technology works. There's something really deep actually happening because it's not just working on language. It
seems to work on almost any modality out there. And I think just like there is the unreasonable effectiveness of mathematics where it's seems very strange. You go out on some branch of abstract mathematics, it seems like it has nothing to do with the world, and then it has something profound to say about the world. You invent complex numbers somehow that describes everything you're going to need to
deal with electricity. Who knew that's going on? In deep learning, where there's an unreasonable effectiveness of deep learning, where the same techniques are working across every modality from DNA to fMRIs to language to audio to video to images to computer code. There's nothing that says that had to have worked, and yet it seems to be working. So we're learning something I think profound about the structure of our universe.
But what that means for us specifically is that that means we can build these kinds of shapes and embed and translate between how an animal behaves and how it sounds and what its body post is. So we can say we're not quite there yet, but we're moving towards it.
Generate me the audio of two elephants coming together, and that's going to view distribution of calls, some of which might mean like hello, some of which might mean, this is my name, some of which might mean I've missed you, you don't know, but has something to do with affiliation. Then you say, okay, now generate me the audio of two elephants coming together, but where one of them's flapping its ears and the other one's running quickly. What kind
of sounds does that make? And you can see that this becomes a laboratory that lets you very quickly iterate to understand what animals are saying. When you get to do this in combination with the incredible biologists that are out in the field and have already built up a lot of that context from time, blood, sweat, and tears.
Excellent, and I think the biologging is becoming more sophisticated, even right where they're looking at temperature and weather patterns and gyroscopes and accelerometers and so on, where you get all of this data from the animals, and in theory, there's no limit to how much we can biologue, as long as we can make it small and portable and gets it on the animals, and then we're able to discover, hey, these are the contextual cues that the animal is responding to with the language.
Yeah, that's exactly right. And in fact, a big shift that's happened in biology and conservation and ethology in the last five years is because of cell phones driving the cost of sensors lower. Biologists have gone from a world where they're often data starved to where they're data drowned, where they have access to terabytes of data, but they
don't yet have the tools to understand them. And so our goal is to decode non human communication, translate animal language, and use that to transform our relationship with the rest of nature. But it's sort of like you're trying to go to the moon along the way you invent velcro. We're building the foundational tools that every biologist needs to
understand the data that they have now. And our hope is that by building those foundational tools or nonprofit or open source, we try to give back as much as we can that that can broad scale accelerate all of like conservation science, which we hope can also accelerate conservation itself.
Now, I have a technical question, which is if you are looking at human languages and making this high dimensional space of all the words when you're listening, when you're eavesdropping on whales or lemurs or whatever species. How do you know what a word is, what a unit of meaning is.
Yeah, a hard problem and there's no one easy solution. But one of the things that we can ask the AI to do is try chopping up the audio in many, many, many different ways and then see which one of those ends up making good predictions for what comes next. And so you can see if you're trying and varying and you're not saying, well, which thing contains meaning, but which things help make good predictions. When you try this on humans, you end up with phonemes that you get out and
then those are then combinatorily built into words. So we're playing with those kinds of techniques, but we don't have like one surefire away yet.
And when you're thinking about predictions, one of the ways that you could test a prediction is with playback, right, So tell us about that.
Yeah, So this is the classic way that you test your predictions in the field, where I'll just go out and they will play a sound, often from the animal, and they'll see whether the animal looks and for how long. What we are starting to be able to do is just like you can build a chat bot in text that speaks Chinese without needing to speak Chinese. We are on the cusp of being able to build these kinds of chat bots, but that just directly speak in the
language of animals. So it's sort of like, imagine you had a superpower, and your superpower was to go out meet someone whose language you don't understand. You sort of cock your head to the side and you listen for a little bit and you're like, I don't know what anything means, but I see that this sound pattern follows this sound platted and this context. You just start to babble and you have no idea what you're saying, but the other person's like crosses the arm, like yeah, wow,
that's so meaningful. And at the end the person walks away. I think they've had a great conversation. You're like, I have no idea what I just said. I was just babbling. But that's what that's literally what Chatchipdi does, and that's the kind of thing that we are going to be able to build in the next you know, like twelve months. And what does that mean?
Just so it's clear, can you give an example of playback and the kind of things that people are doing right now with that yeah.
So an example of a playback might be one of our partners, Michelle Fournet, and you can, actually your listeners
can go watch her incredible documentary Fathom. She was trying to determine how do you say hello to humpback whale and possibly include their name, So to say hello in hump back, it turns out, is something like poop And to test this, she recorded many different they're called whoop calls, but they're hellos, many different whoop calls, and then went out to Alaska, set up speakers underwater and would play the hellos in a very controlled condition and would see
do the humpbacks respond? And the answer is yes, yes they do. When she said hello, they would respond in greater number of saying hello back. So that's an example of a playback experiment.
I know you've thought a lot about the ethics involved in this so far what we've been talking about sounds amazing, and the question is what are the ethical things that we need to keep an eye on.
Yeah, that is a great question because you know we are going to be crossing this barrier very very soon, which is I mean, this is the plot twist that we will be able to communicate before we fully understand what we're saying. That's again very surprising. I would have not have guessed this if we rewound the clock three or four years. What does this mean. This means that if you're working with a species which has vocal learning, well you might inject something that they say that then
changes their culture. So, to give an example, humpback whales off the coast of Australia. For whatever reason, the Australian humpbacks seem to be like the K pop singers, and because they can sing halfway across an ocean basin and they migrate across the world, often the songs that are sung off the coasts of Australia will catch on and be sung by much of the world population within a
couple of seasons. So it's, you know, the ultimate pop tune. Now, we don't know as humans what truly the function of humpback whale song is and how that culture works. So if we just create a synthetic whale that sings, we may infect a thirty four million year old wisdom tradition, you know, create some kind of viral meme a whale QAnon.
We just don't know. So we have to be very careful as we approach this new responsibility of what does it mean to truly communicate with the other cultures of Earth? And that means we should not go out and start playing like two way communication real time. We should not do those kinds of experiments with wild populations that vocally learn. We have to think about what is it to have like a prime direct of a Geneva convention for cross
species communication. And this is of course terrifying, and I should say, everything that our species does we do with biology partners and institutions. We are starting to work on what are the ground rules before we even have the technology for knowing when and how it is okay to have these prime directive first contact moments because first contexts have often not gone well for the beings being first contacted.
So I think the change in the relationship for how we relate to nature is the point of our species and it's exciting that we're getting to the place where that becomes a necessity.
And what's your prediction for how long it'll be, what year will have a meaningful conversation back and forth with the species? And which do you think will be the first species?
Yeah?
I mean This is science, so it's always very hard to make predictions like this, and different people on my team have different predictions, so I can just say mine, but know that answers very I think certainly by twenty thirty we will have had two way back and forth to what degree we understand unknown, But I think we will have a really good handle on it by then. It's just so exciting. My personal favorite is Belugas, and
again everyone has their own personal favorite. But when you listen to Belugas communicate, it sounds like an alien modem. It sounds digital. There are lots of whistles in there. It turns out that you know dolphins, they say their name, their signature, whistle in a whistle. It's like a single band. This is like full modem pack. It encodes their name, it encodes their clan identity. And doctor Valeria Vergaro, with whom we work on Beluga communication, she's sort of like
one of the preeminent scholars. It was her work that showed that they have names that they call each other by. And what blew my mind is that when she talks about her data, she's like she had to throw away ninety seven percent of her data in those studies because she couldn't tell which beluga was speaking or disentangle them. And that's because they are like forty belugas in a tight mass that are moving around super fast. It's very
hard from a computational perspective. But that's where your listener's ears should perk up, because here we have the most vocal underwater species with the largest vocabulary that we know of, and the super majority of data, like ninety seven percent is unknown the ocean is what five percent explored Bluga communication or at least this data sets are three percent explored.
Like this is.
Where you get like brand new discoveries. This is the next frontier.
And do Belugas do turn taking, by the way, which is one of the signatures of an actual language as opposed to just broadcasting noise.
Yeah, a number of species to do turn taking, from parrots to gelatas to many of the whale species.
Yeah, I know.
This is one of the signs that people look at to try to figure out, how would we know if this is actually a language versus they're just singing songs or they're doing whatever, but they're not listening back and forth, which leads to this question about if we find alien species,
eventually we find life on other planets. The question is how much do we have to share with another species for us to have some meaningful interpretation of the language, Because fundamentally we're trapped in our internal model and a species that's so different, we will impose an interpretation on
what they must mean by it. But I wonder when we find an alien species, how we will ever be able to know whether we understand enough of their language to say that we have a meaningful interpretation of it.
I mean, when you say that, it just makes me wonder, how do we ever know that when we're communicating with each other's as humans, that we truly understand each other. There's almost this undeniably huge and yet invisible gulf, like the myth of communication is that it ever happened in the first place. We never truly know. We can only have clues that we are getting closer, that we're approaching knowing.
I think it's really important to call out how much of our language is built on the metaphor of bodies. Almost all of it is body and space, right Like, even the things that we might think are really abstract, like cursor on your computer. What is the root of cursor in Latin, It's cursor the one who runs. It's the man who runs impeded, impeded against foot. It's like the deeper you look into language, the more you realize. And George Lakeoff does an incredible job in a book
called Metaphors. We live by really deconstructing all of the ways that what we think of as our most abstract ideas can be traced back to a root of us having bodies and talking about our bodies in a physical world.
And particular bodies, particular bodies. That that is true.
What I mean is when we find an alien species, let's say they're more like slime, mold or something that might make it very difficult for us to understand their metaphors.
That is exactly right. And I think the hope here is that because we are conditioned on and live in a physical world, that to the extent that there is an outside world in which we share, and that that will give the kind of grounding that's needed to do some kind of translation. But I think it would be wrong to say that the translations are going to look
like Google Translate. You're going to get word forward to English it might end up looking like a translation is more like a piece of art or poetry, where the translation is very ambiguous, but if you spend enough time with it, you start to get a felt sense of what it's like. Or maybe you're right, maybe it'll be so different that we'll never There's just some things we will never be able.
To work right in between, will and pose an interpretation even though it will be incorrect.
Yeah, that is true, And at least here on Earth. There are sort of two failure modes. One is anthropomorphizing, which is what you're talking about, is assuming that we can, well, we can only relate to the experience of others through our own experience. That's the only way to ever happened. It's very simple to say, but it's actually profound when you think about it. So there's a over projection of
ourselves onto others. And then the other side is human exceptionalism, where we assume that our experiences are completely unique to ushen we share nothing with other animals. And obviously the answer that the truth is in between the two. And then we have to have the self honesty to understand and the way of asking questions that lets us determine when we are over projecting.
Yes, exactly, And I'm really interested when and this might not happen in our lifetimes, but when we discover completely alien life, I mean as in living on other planets that might be so different.
Maybe they don't have DNA, maybe they.
Have a different coding system, maybe they have very different bodies. The question is how much is Earth exceptionalism true? You know, in Star Trek they go around and they communicate with all these aliens and they have a good time, and you know, really understand each other to some degree. And the question is whether that will be the case or not.
Yeah, I mean if you start thinking about I think in Star Trek they have the crystalline entity, which is a giant being the size of a whole planet. And at that point, I think I'd come a little more along your lines that the scale of which that being is feeling and sensing is so broad. We probably share
very little but anything of roughly our size. And if they have family structures, like then there is like hunger, there's being tired, there's like safety, there's like familiar relationships, there is gossip, and those things are probably conserved across many, many different types of beings.
So we're entering a really exciting time, but the challenges are real and there are still a lot of question marks. For example, in the scientific literature, there's an ongoing debate about which species might have languages. Some researchers listen to a particular species and say that seems like that could be language, and others listen and they say, no, way, that's not language because there's no turn taking, and also because the order of the sounds doesn't seem to make
any difference. And these are all valid debates because we don't actually know what qualifies as a language and what doesn't. Some species, for example, some songbirds do what's called dueting, where they're singing at the same time. Does this mean they're not doing language or is it possible? Are very different ways of doing language. I'll give you a concrete example of a different way of doing language, which is sign language. It turns out that the temporal order doesn't
matter very much. In sign language. You can switch up the order of the words and it can still mean the same thing. And there are aspects of it that are spatial. So, for example, an American sign language, you can indicate that something happened in the past by doing the signs slightly to your left, and if you make the same signs over on your right side, that means you're talking about the future. So it's the same signs with this subtly different spatial position, and it can mean
different things. And I call it subtle because if someone didn't know to watch for a slight spatial change, they wouldn't even notice it. And even a language that only uses sounds can be very difficult to decode because so much of it depends on shared assumptions about meaning. So just as an example, if I'm talking about someone named Aviva, I use her name once, and in the next sentence I just say her, and you know who I'm talking about.
I'm referencing Aviva. But if you are an alien working to decode my language, you might be confused because one minute later you hear me use the same utterance her, but now I'm referring to someone else entirely.
I'm now talking about Sarah, but I.
Still use the word her, So the same word can refer to totally different things. And the alien would be very confused if it had concluded that her was the word for Aviva, and in the same way when we hear a whale make the same sound that we always hear, it might be talking about something totally different than the last time that used that sound. The context matters, and this issue of context, in other words, what's going on around the animal. This is why biologuers are interested in
collecting things beyond and just the audio data. Good biologuing now uses video and gyroscope and altimeter and GPS and any other measure they can get their hands on. And this matters because so much of communication is about context, and by the way, a lot of it is nonverbal. Consider how you pick up stress from someone else even without words, body language, the tightness of their facial muscles, the way they're walking, and so on, and animals presumably
have many equivalents to this. Just think about smells and pheromones. Take a close look at your dog the next time you're on a walk. It's obvious that a lot of your dog's language is happening silently. So all this is to say that language can be complicated, and much of it can be nonverbal, and this is why the challenge of decoding animal language is a big one. And you know, one of the things that I'm always on the lookout for is whether we can see any evidence that animals
engage in something like storytelling. One of the classes that I teach at Stanford is the Brain and Literature, and I teach how weird it is that we go to the theater or the movies or a lecture and someone speaks and whosh, we get immediately transported into a different space and time.
It's like a guided dream.
I'm going to do an episode on this issue soon, but for now, I just want to point out that we don't see bears congregating like hundreds of them on a Saturday night listening to one bear grunt along. And I'm not certain that we see that in any species, but I don't know. But these are the kinds of clues we would look for as we move forward. These are the questions of not just do they have some simple language, but what they can do with their language. This is a tougher problem and one that we need
to keep our eye on. So plenty of remaining question marks all around us, but what's clear is that technology like biologuers and artificial intelligence are leveling us up into a very exciting time. Not all species are going to
have something interesting to say, but many might. And if we find we can decode animal language due to the labors of Aseraskin and his co founders Katie and brit and dozens of other people in this exciting field of animal communication, that will give us a very different view
of ourselves and our species on this planet. Our grandchildren will grow up and they'll feel amazed that we considered ourselves the only ones and it wasn't even necessarily because of species chauvinism, but instead because we can only hear our own voices, and therefore we thought we were the
only ones in the room. And with enough time, maybe we'll have enough technology and practice at decoding animal languages that eventually, in the more distant future, we can tackle extra planetary communication, and our great great grandkids will be amazed that there was a time when we thought we were the only ones in the galaxy.
We maybe look back upon.
As the era of loneliness, surrounded by voices of all types that we just didn't know how to hear.
Please join me at eagleman.
Dot com, slash podcasts more information and links to various animal communication projects and further reading. Send me an email at podcasts at eagleman dot com with questions or discussion, and I'll be making an episode soon in which I address those. Until next time, I'm David Eagleman, and this is Inner Cosmos.