What happened to the metaverse? - podcast episode cover

What happened to the metaverse?

Jul 18, 202444 min
--:--
--:--
Listen in podcast apps:

Episode description

This week I’m talking to Matthew Ball, who was last on the show in 2022 to talk about his book “The Metaverse: How it Will Revolutionize Everything.” It’s 2024 and it’s safe to say that has not happened yet. But Matt’s still on the case — in fact he just released an almost complete update of the book, now with the much more sober title, “Building the Spatial Internet.” Matt and I talked a lot about where the previous metaverse hype cycle landed us, and what there is to learn from these boom and bust waves. We talked about the Apple Vision Pro quite a bit; if you read or watched my review when it came out, you’ll know I think the Vision Pro is almost an end point for one set of technologies. I wanted to know if Matt felt the same and what needs to happen to make all of this more mainstream and accessible. Links:  Fully revised and updated edition to the “The Metaverse” | W.W. Norton Apple Vision Pro review: magic, until it’s not | The Verge Apple’s Vision Pro: five months later | Vergecast Is the metaverse going to suck? A conversation with Matthew Ball | Decoder Interviewing Meta CTO Andrew Bosworth on the Metaverse, VR/AR, AI | Matthew Ball Interviewing Epic CEO Tim Sweeney and author Neal Stephenson | Matthew Ball An Interview with Matthew Ball about Vision Pro and the state of gaming | Stratechery Tim Sweeney explains how the metaverse might actually work | The Verge Fortnite is winning the metaverse | The Verge Is the Metaverse Just Marketing? | NYT Credits:  Decoder is a production of The Verge, and part of the Vox Media Podcast Network. Our producers are Kate Cox and Nick Statt. Our editor is Callie Wright. Our supervising producer is Liam James. The Decoder music is by Breakmaster Cylinder. Learn more about your ad choices. Visit podcastchoices.com/adchoices

Transcript

Support for Decoder comes from Indeed. Hiring has never been particularly easy. It used to be, you'd have to post to help Juan Dad, sip through resumes, and hope for the best. These days, you can skip the busy work and still find the perfect candidate. How? With Indeed. Indeed is the hiring platform that lets you skip the search because it matches employers with high quality professionals. In fact, according to a recent survey, 93% of employers agree Indeed delivers the highest

quality matches compared to other job sites. That's because Indeed's matching engine is constantly learning from your preferences, so the more you use it, the better it gets. It even helps you with scheduling, screening, and messaging potential employees, all in one place. Listeners of this show will get a $75 sponsored job credit to get your jobs more visibility at Indeed.com slash Decoder. Just go to Indeed.com slash Decoder right now and support our show by saying you heard about Indeed

on this podcast. Indeed.com slash Decoder. Terms and conditions apply. Need to hire? You need Indeed. Support for Decoder comes from the world as you'll know it, a podcast about the forces shaping our future. The season goes inside the unprecedented technological revolution underway as the world

begins to replace fossil fuels with clean energy. Meet the scientists, engineers, and entrepreneurs taking on this challenge and go behind the scenes of new technologies like green hydrogen, carbon capture, and next generation batteries poised to remake the world and the face of climate change. The world as you'll know it, the great rebuild is available now. Hello and welcome to Decoder. I'm Neil Apital, Editor and Chief of the Verge and Decoder is my

show about big ideas and other problems. This week I'm talking to Matthew Ball, who was lost on the show in 2022, talked about his book The Metaverse, How It Will Revolutionize Everything. It's 2024 now and it's safe to say that that has not yet happened. But Matt's still on the case. In fact, he just released an almost complete update of the book, now with the much more sober title

Building the Spatial Internet. Matt and I talked a lot about where the previous Metaverse hype cycle landed us and what there is to learn from these boom and bust waves in technology. We also talked quite a bit about the Apple Vision Pro as sort of a marker or a symbol of where the Metaverse is now and where it has yet to go. If you read or watched my Vision Pro review in the Verge when it came out, you know that I think the Vision Pro is sort of an endpoint for one set of

technologies. And I wanted to know if Matt felt the same way. And what needs to happen to make all of this much more mainstream and accessible. It's tempting to think that the Metaverse just fizzled out after the huge explosion of hype that came after Facebook renamed itself to Meta. Hype which the lackluster quest pro and messy horizon platform couldn't really live up to. And Hype which eventually feels like it got totally washed away by the arrival of generative AI.

But Matt's point is that the Metaverse didn't just disappear. The major players like Meta, Fortnite maker, Epic Games and Roblox, they're all still plugging away at it, albeit gradually. While Meta and Apple go head to head on hardware, the gaming companies whose engines make the 3D

Internet come to life are still working on some of the core technical ideas. All while contending with an industry-wide downturn that's led to waves of layoffs, not to mention a pretty stark lack of consumer enthusiasm and the whole Metaverse concept combined with some intense backlash to both crypto and AI. Matt and I got into all that and more. And he made the case for why the ideas that power what we think of as the Metaverse today are a lot bigger than just buzzwords and

futurist predictions. He's optimistic that we're still on the path towards a new spatial internet that progress is being made and booms and busts are just part of the directory from where we are now to where we might be in the future. Okay, the Metaverse with Matthew Ball. Here we go. Matthew Ball, you are the CEO and managing partner of a pillion and author of the book The Metaverse Building the Spatial Internet, which is a different title for a book that we already talked about.

Welcome to Decoder. Glad to be back. You were last on the show in 2022. The book did have a different title. It was much more expansive title. It was the Metaverse and how it will revolutionize everything. You changed the title. It's a little smaller. Tell me about that. What's going on with this book? So the book is a comprehensive update revision expansion to that 2022 title. It's about 70% net new in content, 40% longer. And so though the subtitle might seem smaller, the book itself

is actually a lot more expansive, artificial intelligence being one of those categories. But I'll tell you, I never really loved the subtitle. It was actually very off-piste for me stylistically. So I did use this book as an opportunity to change that just like I updated and improved a lot of the original text. The first summer of the book, and then as I was reading the new version,

it feels like a textbook in a good way. If you don't know anything, you can read this book and sort of understand you're thinking about the Metaverse as a bunch of definitions in it, which are important. The definitions I'll build on each other. Is that how you're thinking of this? Is the way a textbook gets revised over time? You're going to keep revising this book over time.

The goal was very much to detail all of the technologies, the trends, the behaviors, and the key quandaries that are going to affect the development of the Metaverse, the spatial internet, the 3D internet, what have you. I did not want to advocate for any individual philosophy, business model technology, or even theory. Of course, a reader can nevertheless understand where I'm kind of tipping

my hat and the version of the Metaverse that I would most like. But the goal was to take a more factual basis and explain to readers how we got here where we might need to go so that whether or not you were a content marketer, a entrepreneur, a large company executive, you could understand these trends holistically and then make your bets accordingly. You say tip your hand. This head will tip your hand. You have a definition of the Metaverse. It's the spatial internet.

It's the 3D internet, I think you call it several times. It is the one you think about where you exist in a video game with other people right now. It's the closest I think we have to it. In that environment, persists, you can take actions in it. You can pay money in it. You can do all that stuff. Is that still your working model? That was certainly the working model we talked to years ago. That's quite right. I finished the original book in truly the last few pages where I

get a little bit more speculative. I make the argument that by the end of the decade, many people are likely to acknowledge that the internet that we experienced today, that being 2022, had changed. It had become more immersive, more embodied, more experiential, more 3D. But I also say that it's unlikely that we use the term Metaverse at that point. In fact, it's unlikely that we used any of the terms save for the word internet and perhaps the 3D

internet. The one flaw or foundational flaw with the Metaverse, beyond its association with dystopian literature, beyond its association with a specific company, and beyond that perhaps failed projects in both crypto and VR, is the fact that it is very much perceived as an end state, right? The Metaverse is a fully realized experience. That makes understanding our trajectory

from whenever to there, really hard. The goal here was actually to separate away from an end state, and to instead talk about the minor contributions, the major accelerants, and the overall pathway to getting there. Whether we call that spatial or immersive, it's kind of immaterial. In the two years since you're at the first version of the book and you're on the show, what are the minor iterative steps and what do you think are the major accelerants?

Well, I think there are three areas that have exceeded expectations, and I like to highlight that blockchain is 15 years old. HMDs are head mounted displays, or roughly 70-year technology, and then artificial intelligence is varyingly dated at around 70 or in some instances 100 years old. In each of those areas, it feels like the last two and a half years have actually felt more like

decades of acceleration. Artificial intelligence is a super clear example. When you take a look at head mounted displays, the introduction of the Vision Pro, though it hasn't changed the world as we know it today, it's a brilliant case study because it shows you what perhaps the most technically capable, most brand savvy, and most accomplished tech pioneer hasn't has not been able to achieve with the device category or the form factor, and then blockchains, essentially 70% of all money

going to that technology has gone in since that book was published. Probably 95% of total transactions nearly all users, and of course we crashed from a peak market cap of $3 trillion down to $800 billion.

We nearly reclaimed that high a few months ago during that time we had countless failures of technology, of products of entrepreneurs, and so those three areas, though again between 15 and 100 years each, have changed quite comprehensively, and so actually bringing users through not just to understand that new history, but to place it within new context and to better understand and acknowledge what the problems are, felt like one of the most important updates to the book.

Let's start with the Vision Pro because it's the flashiest thing, it probably listeners understand it the most is the most different thing. I spent a lot of time with it, I reviewed it, my read of it feels like it echoes yours, right? Like here's the best we can do, it's nowhere near good enough. There's a part of me that says, and I put this in my review, that maybe camera-based pass through and on screens in front of your eyes, maybe we should just admit to ourselves, this is a dead end,

and we have to build some other kind of technology to make this work. Are you seeing the Vision Pro that way, or do you see iterative steps from this Vision Pro to something that enables more of the metaverse that you have been thinking about? So I think you and I are largely aligned, in fact your review is quoted quite extensively in the book itself because I thought it was particularly insightful in that same regard, and I mean that, honestly, I think of it in a few different ways.

First and foremost, I think it is important to recognize that while we don't know how much Apple has spent building this device, we have some semblance of an idea. Since Mike Rockwell, who led the development to the Vision Pro, began his group in 2015, Apple has spent roughly $135 billion on Total R&D. They don't have product PNLs, they probably couldn't even tell you the answer, how much did they spend, the investments in...

I feel like Tim Cook knows the answer. I know Apple likes to say this about itself. I'm confident Tim Cook knows the answer. Well, I'm sure he can tell you in some vague sense, but my point is just extricating Silicon development for the Vision Pro from the rest of their line is difficult, but the point is, Tim Cook proudly said this is our most advanced device ever. It's the most

sophisticated piece of consumer hardware ever produced. He said 5,000 plus R&D patents went into the device specifically, not the broader corpus of work that might include the Vision Pro 2, optical AR glasses, but just the Vision Pro. That's about 25% of all patents they've filed since 2015.

And so no matter how you allocate that 135 billion, you're getting to tens of billions of spend, not identical to meta, which is also spent on marketing, on content, on device subsidies, but that is to say we now have two companies that have spent tens of billions of dollars, have slightly different stylistic interface product optimization and trade-off choices. And we feel like both of those devices are far away from being mainstream.

When you go back to that initial announcement, I remember J. Peters or perhaps Alex Heath had that leak from Mark trying to reassure his staff. And he said, we actually find this reassuring because the worst thing that could have happened was that Apple had discovered something we had. And instead he felt reassured that there was no new science. So the reason why I say this is, you go back 15 years ago, it was consensus in Big Tech that this was going to be a solvable problem

by the end of the decade. Not just that we could produce the device we wanted, but that we would have and hundreds of millions of consumers would have embraced it. 15 years later, companies like Meta haven't even shipped their optical AR display. The introduction of the Vision Pro is simultaneously an affirmation that the ear of HMDs is here yet a reminder that it's very far off

for the average person. I'm a little bit more optimistic as to whether or not the Vision Pro has us on the right path partly because I think when you separate all of the constituent parts, you can see the progress. Our devices have roughly the same battery life, roughly the same price point, roughly the same weight as they did seven or eight years ago, but they have four times the sensors, three times the screen resolution, three to four times the frame rate, they're capable of doing

far more, they have spatial audio and so on and so forth. But I would say that we have certainly learned that that day that 10, 15 years ago we imagined would already be here is still probably 10 to 15 years away. So the data point here that I think of a lot is inside of Meta. You actually just talked to Meta CTO Andrew Bosworth who is sharp on the Metaverse and the amount of money he's spending. They restructured, right? They said, okay, look, the quests and the headsets are going to

go in this division, the glasses, the Meta Rayban sunglasses, that is a great product. It's finding its own product market fit. We're going to put all of our effort there and they're moving away from the Metaverse ideas that prompted the name change into what you might call augmented reality with the Rayban glasses, which are basically just a voice assistant and some headphones and a camera and sunglasses. And that's where the consumers are. Do you see that as evidence that this is actually

getting more refined or that 15 year old map has another 15 years to go? I mean, interested by your perspective there because I would disagree with the characterization. Now the top part about that is that organizational changes are opaque. They're partly four PR and optics and they're never really going to explain how the priorities have changed. What we know is that Vishal Shah who is in charge of essentially the software and it experiences layer four quest devices now also runs the hardware

and now both of those divisions report directly to Baws who runs all of reality labs. That seems like an elevation of the software side of the company. The AR glasses themselves as I understand them still report within the Metaverse division still report up through the rest of that team. It does seem that the artificial intelligence layer is coming from another part of the business, but the implementation for that audio assistant is still going through the reality labs group.

The more important point that I would argue is if you go back to 2021 when Mark changed the name of the company, he was quite clear in both the hype videos that they released as well as his own talking points that AR mixed reality, traditional 2D interfaces and VR were inextricably linked core and parts of the Metaverse and that there was no starting or ending line between those experiences. The downside of that was the only device you could buy from them at the time was virtual reality.

The only thing that you could really experience of their Metaverse group was virtual reality and therefore every demo that they had was a virtual reality. That has had this lingering effect where people say the Metaverse is virtual reality, even Neil Stevenson who largely adhered to that when he wrote Snowcratch in 1992 has publicly separated himself from that idea, but there's still a lingering perception. We're seeing more of that, right?

Did some of these companies are actively trying to distance themselves from VR or at least the idea that they only do VR? We see that with Meta and the Ray Band glasses and to some extent with the Appalition Pro. Appalion only talks about it as a mixed reality device with pass-through, let's you stay in your environment. That's been the big bet in Silicon Valley for a long time. We're going to get to actual augmented reality. We're going to layer digital information over the

world you're in. My killer app for that is just please help me with faces and names. I don't spend any amount of money on a device that would help me with faces and names, but that's, you know, to do that you have to build a worldwide facial recognition database. There are some costs along the way. Is that part of your Metaverse definition, this more traditional augmented reality that everyone's been talking about for so long? Yeah, and this gets to the idea of the 3D internet,

right? It's where we get into the ideas of persistent digital twins, the idea that the way in which you've actually solved for self-driving vehicles at level 5, at scale with improved accident rates is to build persistent, essentially UGC contributed simulations. We know in fact that that's

a significant part of Tesla's roadmap and part of the Robotaxi plan. They are today building a persistent live Unreal Engine-based simulation of San Francisco and their idea is essentially that every single part of their self-driving car network, including privately owned vehicles, would be transmitting LiDAR infrared radar scans to build that 3D representation. And not only would that be used to aid the driving cars themselves, it would become essentially infrastructure for

the city, for emergency services, for ads and what-have-you. That's an important part. If you rewind three years ago, Jensen Huang took a lot of flack for making the argument that the Metaverse was eventually going to be half of world GDP, which still sounds fantastical and is in excess of

even my expectations for it. But his perception there was actually the same, right? The fundamental processes of the modern economy would be running through industrial grade 3D simulations, which in his perspective was the Metaverse, rather than just a consumer leisure VR headsets experience. We need to take a quick break, we'll be right back. Fox Creative This is advertiser content from Verizon. With Verizon, you can finally create an internet plan

that's made for you, whatever era you're in, with my home. Now you can choose exactly what goes into your Files Home internet plan and save on the entertainment you love. So if you're in your roommate era, you can choose the streaming services you both want, even if you can't agree on what to order for daycount. I got it. Or if you're in your parenting era, you can save on the entertainment you and your kids love every month. Say hello to internet your way. Create your Files Home

internet plan starting at $35 a month with auto pay in any Verizon mobile plan. Call 1-800-Virizant to switch today. Availability varies for existing Verizon post-paid mobile customers excluding pre-paid business and data-only customers who then add and keep a Files 300 megabits per second plan. Mobile and home discount enrollment required, auto pay and paper free billing required, $99 instead of another terms apply. Hi, this is Cara Swisher, host of On with Cara Swisher from New

York Magazine and Vox Media. And wow, what a month we've had. There's so much going on right now to ongoing wars overseas, deepening political turmoil here in the US and a presidential election that might now be in flux. Well, we've had a great lineup of guests on the show to talk about it all from the US ambassador to NATO, Julian Smith, the governor of Gretchen Whitmer of Michigan, to my latest episode in interview with Rachel Maddo of MSNBC. Knock that off my bucket list. I'm so

excited to talk to her. Have a listen. If the Democrats replace Joe Biden with Kamala Harris or with any other candidate, will they have a better chance at beating Trump? I don't know another do you? We can't tell from this vantage point. But if Joe Biden were running against Donald Trump today, he would lose and likely lose badly if the polls are accurate. The full conversation

is out now and you'll want to hear it. Find it wherever you get your podcast and be sure to follow on with Cara Swisher for more kick-ass conversations like this one. Even before this past weekend, this election was bonkers.

First of all, it's a straight up rematch. The rematch from hell, the rematch no one wanted, former president versus current president, newly convicted felon versus father of newly convicted felon, the two oldest major party candidates to ever run for the top job record-breaking old men. One guy facing more legal challenges than every other president in history combined. The other guy facing relentless calls to step down from just about every corner of his own party.

But saying he's got to stick around because American democracy is on the line. We had never seen anything like it before, before this past weekend, before a kid in Pennsylvania tried to kill Donald Trump. America just dodged a bullet and maybe we can learn something from it. That's on today explained. We're back with Metaverse author Matthew Ball to discuss whether the tech we have today is at all suited to actually building the 3D internet.

I feel like you're a good person to talk about these ideas with because one of the things that I'm really challenged with the Vision Pro with AI as it exists today, with digital twins as they exist today. The whole thing is the process by which we get from the products and services we have today and the technologies we use to make those products and services and where we might want to go is one not linear. Right now it feels to me like I'm not even sure that the core technologies

we're using are the ones that enable the next step that everyone wants. So I'll just use AI as an example. I'm really unsure that LLM technology is the thing that can build the AI systems that everyone's actually selling. We've invented a language model and maybe it will never actually reason and maybe we don't want to live in a video game where the AI models are fully hallucinating without any sense of what the player is doing. Do you see that gap? That's kind of what your book

is about. This is going to happen in fits and starts but right now there's a lot of emphasis on one or two core technologies that might not be able to take the pressure of the expectations. What you are highlighting, the perception that transformers solve important use cases today that are much better than the solutions we had a few years ago but don't scale has actually become increasingly consensus over the last six to eight months. John Lekun who runs the AI division at

meta is particularly clear about that. He tells researchers starting their careers don't focus on LLMs. John Carmich is perhaps my favorite example. John was one of the co-founders of id software. He's considered the godfather of 3D graphics. Later he became the CTO of Oculus VR in 2014 and

left met in late 2022. He started his own AGI startup and he has made this argument that he believes that all of today's technologies are incapable of getting to AGI and he says all of the pioneers have been distracted by what he calls multi-billion dollar off ramps and he doesn't besmurch anyone from doing that but he just says you're never going to get there if every time you see a multi-billion

dollar 10 you pursue it. He has instead made the argument that he believes that actually many of the fundamental premises around AGI from the 70s and 80s and 90s are actually a better pathway. It's just that they were technologically impossible at the time due to multiple different constraints whether that was edge computing networks banned with capacity or just the scarce and poor availability of GPUs at the time. And so part of the point of the book is to

talk about the end state of the metaverse. Chapter five is not just a definition of the metaverse. It's the full spec metaverse. The book itself is designed to tell you how we start to get to that end state but then to detail the many different uncertainties but I will say very conclusively that as critical as AGI is to building the metaverse and despite the many ways in which today's transformer models multi-modal LLMs and accelerate that path most believe that very different

systems and fundamental architecture is going to be required. You said full spec metaverse. Very quickly tell people what you mean by that. So what I'm attempting to do is to define the metaverse not just by saying a 3D internet but to describe the expansive vision that when Mark Zuckerberg talks about this as a multi-decade transformation when Jensen Wong talks about a multi-decade

transformation Tim Sweeney what are they actually describing. I use a variety of different modifiers and the reason why I say this is if you say what's the internet it's the TCP IP or internet protocol suite. And so actually defining the internet technically is not a very good way

to explain to the average person what the internet is. Instead we want to talk about the internet being a consistent cohesive comprehensive way of exchanging data across 110,000 autonomous networks 4 billion plus applications 150 million different servers and billions of end users and devices. But what we don't do in that description of the internet is talk about scale talk about

experiences talk about applications talk about hardware. And so I have a full spec version of the metaverse that basically says it's a massively scaled and persistent 3D network that can essentially be experienced or co-experienced by everyone simultaneously at some sort of rendering requirement that we consider as basic visual fidelity comparable to the real world and where we can interoperate and maintain various forms of data our identity our payments our objects our history.

And that's an effort to set up that end state so that we can then walk back to what we lack today and then talk about the technological point solutions problems and hypotheses for closing those gaps. So let me just comment that again from the lens of here's what we have today. Yeah the vision pro

will just use that it's easy. Apple doesn't want it to have full immersive environments even though those are the most compelling apps inside the vision pro the idea of it is that you will stay in your environment that you will pass through information it's not building a simulation environment just

passing through camera information there's some amount of AR involved in there it's actually not a lot which I think is surprising for that product given Apple's enormous investment in AR over the years is that the kind of stuff you're thinking of or is it more immersive more VR-ish?

It's not more immersive and more VR-ish. I think again this is why I talk about the internet protocol suite is we're experiencing the internet constantly we're not actively logging onto it it's running sidewalks it's running security badges in our office it's the way that our on-star guide in a

GM vehicle is identifying that a crash has happened and then alerting the authorities we think about it as this again comprehensive coherent and consistent network for the ubiquitous exchange of data across all forms of different applications devices and intelligent systems upgrading that

to 3D now naturally when we talk about 3D and we talk about that end state vision where you have more consumer applications more time more people more often engaged in these immersive environments it is sensible that having a more 3D native interface is important and you can see that right

we have a billion people a month engaging in a 3D real-time environment through Roblox for night call of duty and so forth but if you haven't grown up with controllers and hands if you're not familiar with dual analog sticks it's hard and even if you have there are fundamental limitations

to what you can do in those environments because button mapping is finite and the precision of all of those inputs is still mediocre and so we naturally assume that if you want to fully leverage 3D environments in the classroom in healthcare in design that you require full immersion into that

environment you need full digital dexterity and that in order to get older generations and more use cases in you just require those devices doesn't require VR but it at least involves some form of eye-based device yeah it's very visual that that's kind of what I'm getting at right you've got

to put something over your eyes you got to put something on your head and that seems like where all of these plans kind of fall down because that technology is the one that is hit the clearest I wouldn't say dead end but the clearest stall right this is the best we can do and it's

still very complicated and very expensive and pretty fiddly and then the utility doesn't overcome the fiddliness I'm totally with you I mean look I would say but the vision pro it is clear that it is a remarkably crafted device that can perform some tasks far better than any other device and yet

I think that those few things that it does better are far short of the things that it does worse and at the end of the day the big challenge for any of these head mounted displays be it AR glasses or VR MR XR goggles is that the smartphones big advantages it was probably your and my

second computer alongside a PC for most people on earth it was their first computer and thus also their first access pathway to the internet but for everyone today an hmd will be their fourth fifth sixth seventh eighth computer and right now those devices are very far from replacing your

need to carry your smartphone or iPad or PC to and from work and out shopping and the few instances in which it does one of those tasks better it's not good enough to replace any of those devices and it's not good enough to warrant being held in your bag yeah I guess the comparison

half end is really apt here right here we're going to give you a second computer in the instance and many in mobile generally around the world we're going to give you a first computer that is an excellent general purpose computer I think that it was a CEO of Blackberry who said we

didn't realize they weren't competing with us they were competing with your laptop and so you've got now you've got this excellent general purpose computer it's going to eat everything else well you are describing is the actual reverse right we keep taking shots at a general purpose spatial

computer whether it's the quest three or the vision pro or whatever else it is in the general case is too hard so we take even more expensive shots is like a vertical in those might be working but it's hard to see how you go from the very like targeted vertical expensive to the general

like cheaper mass market I think that's where you get to the new horizon OS strategy where that's meta is OS for the quest correct and they've just opened it up to various partners you know in my interview with boss the cto at met an edit reality lats he talks about the fact that there are

currently three different challenges facing xr devices and unfortunately they're a vicious cycle one is the price the second is the content and the third is the form factor and all three of those things affect one another right if you want to improve the form factor that typically means it's

lighter and more comfortable that typically means it's less powerful and that's going to impede the content on top of that the more skews you have on form factor the harder it is for any content developer to make something one of the fundamental premises that apple had was that

they can build a remarkable device that will enrich the content ecosystem but if you're Disney as an example right now you can make something much much better that is just for the vision pro but the vision proper probably has 200,000 total unit sales and the quest has 20 25 million and so the

tradeoff means that you probably want to build to the largest common denominator not to the top end of the market but that means you're not building pioneering content that is going to best demonstrate the vision pro and drive further adoption but the premise of the horizon strategy seems to be

that general purpose device for the reasons I mentioned earlier is elusive and so let's instead do an ecosystem where if logitech wants to come out with a hundred and fifty dollar device that is super light that is only built on cloud or is designed to be tethered to an xbox or playstation

only uses controllers and therefore doesn't need external cameras for hand tracking that that will best advance the ecosystem if a surgeon wants to build an enterprise version using the quest hardware they are never going to need hand tracking it's not precise and reliable enough so let's again

ship that off that seems like it might be the best bet and would say that let's build the supply chains let's build the software let's build a highly fragmented ecosystem of software applications but collectively share the r&d collectively push adoption and maybe fifteen ten years from now we can

start to converge into the mythical device that we hope for and met up with the operating system vendor who takes fees from everyone it's a good strategy it's played out in various ways over time it's just very counterintuitive now and I would argue that like that is probably one of the challenges

of the vision pro today as I mentioned the hollywood use case well the reality is putting aside that it's three and a half thousand dollars and I like to remind individuals that in most developed markets the sales tax on a vision pro exceeds the price to purchase a quest three that's how large

the price gap is it is a way over featured device if what you want to do is review dailies in all the way we have to take another quick break we'll be right back we're back with Metaverse author Matthew ball the talk about interoperability in gaming and what needs to happen on the software

side to bring us closer to the Metaverse the place where the Metaverse might be most accessible to most people today is in games does need just gave epic billion and a half dollars in February to grow fortnight to grow all the stuff that epic is doing to participate more there from an i with

IP relationships you talked about real locked real locks is huge the key piece of your definition of the Metaverse or 3d computing is that these things will have to interoperate right you don't want to you know the hand over your world to Disney and epic and then have a totally different

identity and rewatch or maybe maybe some people do but to build the kind of economy you're talking about the kind of experiences that you're talking about you definitely need some interoperability is there any hope of that coming because it doesn't feel like these companies are incentivized

to do it so I love this question it's actually one of the more important reasons for the book update which is over the last two and a half years I think most people came away saying that was a bubble I certainly haven't seen the quote unquote revolution that I was promised met his name change

doesn't seem to have changed their trajectory now a i is at the forefront and of course blockchains have come and gone as a result like I wouldn't begrudge people for saying like hasn't this been proven isn't it dead duly rejected by consumers the goal this book is really to talk about the arc and

progress of those technologies and I think that those very high level narratives have actually led to us overlooking the very important progress to getting to that end state interoperability being one such example through regulatory action most of all but separate from that actually new technology

and investments at the platforms we are seeing that progress apple in concert with disney and Pixar as well as their arch nemesis epic epics own competitor in unity microsoft and meta have established what jensen long has called the html of the metaverse o usd as a file format for sharing an exchanging 3d information epic is now pioneering a programming language for the metaverse called verse that various parties have attached to that includes transaction based memory for the exchange

of virtual goods the disney announcement alongside their lego partnership is clearly oriented towards off platform exchange of not just world but user entitlements disney said that very clearly they're like we will operate cell and merchandise separate from the epic team even roblock has started

increasingly open sourcing a number of their different technologies and apple for all of its pro inhibitions on the iphone and despite its protestations against regulators worldwide the vision pro is actually their most open device in quite some time they support open rendering standards such as web xr and open xr and if you can believe it there right now allowing enterprises with raw camera access feed even on the iphone a developer does not have raw access to what the consumer sees through

their smartphones but they get to do so and then exchange share and locally store that information on or when using the vision pro and so the answer is look over two and a half years there's a real cap on how much progress you can see an inter operation you see more technological improvements

and commitments to openness then you are likely to see actual commercial agreements and the amount of actual products deployed is going to be fewer still but I do think that there's been a great amount of inter operation since it's like the disney example it's simple it's understandable

disney sells a lot of merchandise they sell a lot of toys and t-shirts and princess had I just want to disenroll the bottle of stuff the idea that I can buy that stuff in fortnight and it won't just go to roblock so I decided to play roblock's right that I can buy these digital goods in one

environment and they don't appear in the other one right now that's the status quo the turn is I buy them in fortnight and I have the same stuff in roblock's like that's the first yeah to my mind the first easy consumer term there's a bunch of technologies that may or may not enable that

but the blockchain is supposed to know who knows if it will but those are the kinds of technologies that might enable that stuff wanting to do it is a different problem do you see any desire to want to do that because disney's giving the money to epic you have to assume they're going to

want to see the return from their investment in epic versus okay now you can also buy the stuff in roblock's so there's a few different things there I think one that is perhaps understated because the data is really opaque is that we are starting to see a cap on how much individual

users are willing to spend on cosmetics partly because of what you would call the repeat purchase problem right like how many times are you actually going to buy a spider-man skin right like it was very new five or six years ago you got excited you could be in spider-man avatar with your

own backpack but once you've purchased it nine different times in pubg in call of duty in fortnight your inclination to purchase it again goes down and we're starting to see that there was a report out the other day that's showing that epic is actually making fewer skins now than they ever

did before with an increased reliance on third party IP integrations and despite that fact sales are going down and so there definitely is a intent to open that up under the belief that if the utility of a purchased increases that the willingness to spend will go up and that more purchases will

be will occur I will tell you first and foremost there are actually very few people who believe in the metaverse idea who believe that this is the leading use case right at the end of the day like great you can be peely the banana in more environments but it's not clear how important that is

at the end of the day though that is actually where we see a lot of the progress being made gaming is where most people are experiencing sort of three during that the gaming industry is also in turmoil yeah there's more players playing there's more money flowing through the system and

there's more game studios going out of business is that just an industry shifting towards okay all of the experiences are going to happen in a handful of games or environments versus what we've been doing for years which is lots of lots of new games the challenges that the gaming industry

are facing are manifold and that's why we're seeing such turmoil it's not just interest rates it's not just capitalism run a mock it is a reflection of several years of accelerated growth followed by several years in which revenues have actually declined at a point in time in which the cost of

labor has gone up a reflection of both justified increases in individual compensation or improvement in work-life balance a shift towards unionization but it's unfortunately been in parallel to a pullback and consumer spending it's remarkable to imagine that among every single major media category

gaming is the only one that has contracted since the pandemic not stabilized at its prior levels but it's contracted and that has had pretty significant consequences that are also in contrast to what everyone expected there's not a single forecast you can find from 21 22 2023 that didn't

suggest that the industry was going to have grown tens of billions by now that it did not and unfortunately that has bled down right to the bottom but at the end of the day what you're tipping your hat at is also true which is like any increasingly saturated mature channel a few

platforms are increasingly powerful in every measure revenue profit the developer scale the profitable developer scale the predictability and the safety of incremental investments and their share of time data and consumer spend and that has made it very hard for all other games to

compete I think one reason to be optimistic actually for inter operation especially from epic and roadblocks is that by opening up they're actually reducing some of the barriers to third parties to compete right one of the challenges if you're an independent game developer is you want to

bring an entire friend network over to your new game and then you want to somehow convince them that even though they've only spent five minutes playing your game they should buy a spider-man outfit and they have to hope that they were even able to convince marvel to give them a spider-man

license and so the hope would be actually from the epic perspective which is a platform not a content company though epic fortnight uefn like roadblocks and minecraft are becoming larger more dominant there's more user lock in of entitlements and spend and time and player networks and

avatars that actually opening up will start to refer lies the rest of the gaming industry what do you think this all goes next you obviously have updated the book you've been talking about both big changes and minor incremental changes I assume we'll have you back another year or two to talk

about the next version of the book what are the things you're looking for next as markers are progress towards the metaverse I think the big commercial deal or inter operation between the big platforms is the most important I think the interesting thing is if you take a look at

2015 to 2017 it's inextricably linked with the success of the metaverse in 2021 2022 it's no coincidence that saatia and edela that tencent roadblocks unity epic and facebook all started talking about the metaverse at the same time and that's because a number of different things that happened between 2015 and 2018 all matured ipads became capable of running real triple a video games we had the rise of battle royales a genre that has long been contemplated but had

only recently become possible with consumer grade GPUs and with servers able to manage that synchronization we had the simultaneous rise of micro transactions and battle passes and then most importantly the floodgates on cross platform blue open in 2018 strengthening this network effects of all gaming systems that shifted over and three years later we had a gaming world a digital environment that was very different than we had the challenge of that question now is there's a few people actually

expected that came from an explosion to happen and actually now to your point on gaming most of those tailwinds have expired like there's no new games that are going to shift across platform battle passes don't seem to be lifting revenues anymore mobile is no longer growing social gaming has

essentially reached all of its addressable market there was a hope that virtual reality that web three gaming that the metaverse would be that next growth engine it hasn't happened yet I think there's a plausible case for generative AI which faces its own legal and ethical barriers but I

don't know what that next big explosive moment's going to be yeah well we're going to have to have you back when it happens let us know Matt thanks so much for joining the show thanks for having thanks again to Matthew ball for joining us on decoder his newly updated and revised book the

metaverse building this facial internet is out next week on July 23rd your thoughts about this episode or really anything about decoder you can email us at decodertheverg.com we really do read all the emails you'd all say me up directly on threads I'm at reckless 1280 and we have a TikTok

check it out it's at decoder pod it's a lot of fun if you like decoder please share it with your friends and subscribe wherever you're podcasts if you really like the show hit us with that five-star review decoder is a production of the verge and part of the rocks in the podcast network our

producers are Kate Cox and Nick stat our editor is Cali Wright a supervising producer Liam James the decoder music it's my break master cylinder see you next time with Verizon you can finally create an internet plan that's made for you whatever era you're in

with my home now you can choose exactly what goes into your files home internet plan and save on the entertainment you love say hello to internet your way create your files home internet plan starting at $35 a month with auto pay and any Verizon mobile plan call 1-800 Verizon to switch today

availability varies for existing Verizon post-paid mobile customers excluding prepaid business and data only customers who then add and keep a file 300 megabits per second plan mobile and home discount enrollment required auto pay and paper free billing required $99 set up in other terms apply

This transcript was generated by Metacast using AI and may contain inaccuracies. Learn more about transcripts.