Enhancing Education with Interactive and Immersive Experiences

And it's really exciting what people are gonna come up with over time. So, I'll get to my interview with Matt here in just a moment.

You can have as many of them as you want. You can create a movie theater in your living room and tune out everything else that's around you visually. For as long as you want to. I mean, it's just it is, it's hard to speculate on what it will become. Because a lot of folks, I bet even a lot of folks at Apple don't even know what direction our developer's gonna take it. What do, what are the things that users are gonna come up with? It's gonna be a revolution in how we engage with digital media.

I.

a platform like Career View XR can be viewed on standard devices, you know, non, non vr, non AR devices. It can also be viewed in immersive rooms like immersive me immersive realities, walk-in rooms that where you can engage in a space. But I think that the real differentiator was something like Apple Vision. Pro is, yes, it is a one-to-one device, but it's more than just a viewer. It is, it gives you an opportunity to interact with objects in your space. It's mixed reality.

It's true mixed reality where the objects are within your space and it's kind of a convergence of the virtual world and your real world and that's something that just. You know, Microsoft had the HoloLens years ago, HoloLens two. They've kind of, pulled back on their work there and what Apple's doing with Apple Vision Pro is okay, it feels like light years ahead of where it had been even just a year ago. And I haven't even tried the thing yet.

I've only seen the video that they put together, but the enhanced field of view all of those things it just. I get the sense that this is going to, this is gonna build the same sort of just passionate follower that's that the iPhone did.

to kind of see what's in your world and en engage with digital objects in your world. I think the biggest difference is they have their own they have their own ecosystem. They have their own devices, but Apple Vision Pro it is the Apple Store. All of your apps are accessible. The ones you already know aren't, can now be consumed in this immersive way. And I think that's the. Biggest differentiator right now is it's not a separate marketplace or ecosystem.

It's an enhancement to Apple's already really strong ecosystem.

But then there are other apps like the cooking app that I just love, where the developer is actively preparing a release for day one of the thing, the app's called Crouton and just looking at his stuff on threads, I can see what he's doing and how

cool it's going to be to experience that. And like he even showed a quick little demo of. Walking through the steps of creating your meal in your kitchen and saying like, okay here's my counter and here's how big of a pan I need. What does that look like in my actual space, and how much is this actually going to make? Like, I don't know how far down that road he's gone 'cause he didn't show that or anything, but just that idea of.

Like not even having the Vision Pro, let me just say this app has helped me be be a better cook because of how it's designed. That's not an insignificant thing, you know, and what this guy is dreaming up for, how it's gonna interact with the Vision Pro, I think is gonna be really amazing. I can't wait to see what that's like and what that feels like and what the experience is.

I mean, there's also, it's not there yet, but that is where it, it will get, I mean, we've all, we've seen the movies about, you know, the robot helper that's in your space that does the laundry for you, that sort of thing. And, you know, may maybe we'll get there too, but that's a big piece of hardware, right? Imagine now having something like that, but it's all digital and it's just presented to you. In an individualized way for the particular task that, that you're doing?

I don't think we're that far off. From those sorts of things.

I ordered it, it came, it was totally different from the part that, it was replacing, or that I thought it was replacing, and I was just so frustrated that I just said, okay, we're just gonna go buy a new washing machine, 500 bucks. Like it's worth it to not have to deal with this. We've already been without a washing machine for a week and a half

now, for me personally, that's just my own weakness. Right? But then I was thinking like, what if. I put this headset on and I call this guy on Zoom and I say, you look at what I'm looking at and let's walk through this process together, and you tell me what to do and where to go and how to like do these different things. How incredibly powerful would that be? To like we, because this is all going back to that idea of the enhancement of the current offerings.

Because Zoom, like I can have a Zoom call and point out what I'm doing. And what you don't get is you don't get depth. It's all flat. And with this, I imagine if I could, if I can point the cameras out and see what the person can see, what I see, instead of just seeing the superimposed face that Apple's gonna create. If they can see what I can see, that would be incredibly powerful to say, no, go two inches back. That's the screw that you need to unscrew. That's the part.

And then being able to like look at that part and doing a search like, like you said with AI that says, okay, this is the part I see as we're doing this, I saw the model number for your washer. I see the part and I can go through this database and find that specific part and be able to. Show you exactly what you need. Then pull up a video saying, here's how you replace this thing on your specific model with your specific part.

Like, oh my gosh, Matt, that's just mind blowing to think I might able be, might be able to repair things in my own home.

When you pull it out and set it down, where did you put it? That one of my achilles heels is, where the hell did I put the hardware that I pulled out of this thing? You know, granted you would have to, I. It would have to if you moved it when it wasn't in your view, you would lose it. But I bet they're working on a solution for those types things too. But you could watch the entire process fold out digitally before you even touched a tool. I. And yeah, that that's coming.

It's already here in, in an industrial setting. There, there are workplace training programs, I believe that have been done through HoloLens. That's like Boeing Mechanics, being able to the intricate pieces and all of the. Fittings and things that go into aircraft maintenance, being able to watch and observe that, I mean, those types of things have already been done at an enterprise level and it's coming for consumers now too.

I saw a video the other day of Facebook's meta quest or Meta Quest three, having a video explaining what it could do and in a work environment, which they haven't really. Talked about a ton before and kind of in an answer to what what Apple is doing, which is pushing productivity as a main use for this device. And certainly there's a lot of consumption in there as well. But they're talking about, you know, adding keynotes on there and stuff like that.

And. I'm curious to see how that works in practice and how, you know, the work that I do on a day-to-day basis, will that be easier or more difficult or what? And so I think about those types of things and how Apple's saying this is how we are pitching it, and how we're viewing people using it as productivity and what that means for the user and what they can do. So there are certain limitations that exist by design. Because they want it to be used in a certain way. What?

What's your thought and take on that.

I mean, Vive has their XR elites that has really great pass through, high resolution and does very similar. It's on an Android operating system. We're gonna have, we're gonna have the two camps, right?

But it's gonna come down to user preference ultimately, and I think it's gonna kind of fall into the two camps again, the Apple camp and the Android camp.

lab. That's, I mean, thinking about a chemistry lab, that's not just virtual reality, but imagine now that VR chemistry lab is augmented reality or mixed reality, where you can lay out everything on your actual. Not a virtual table in, in in a virtual space, but you have now it, and you know, you pour and it flows just like it normally would and you're engaging with it within your real world.

I think it, it provides all kinds of opportunities to convert real world learning spaces into any sort of lab you might want. I remember the magic leap years ago. They had they were, they had all these advertisements and they were showing the whale jumping out of the gymnasium floor and splashing down, and I was like, oh my God, I want one of those. How can I buy AEM Magic Leap? I'm like. No, they don't. This, was a hype video that, that doesn't exist yet.

Those types of that conceivably does exist with Apple Vision Pro. And inevitably the technologies that are gonna follow, I don't know if there's, there is syncing with those things yet. I think ultimately for classroom instruction, the ability to sync all of those things and you are doing an experiments and. All the, you've got these 3D models in front of you and everybody's vantage point is, it's as if that object was there in the real world, right?

That's where it's gonna become incredibly valuable for education. But right now, I mean, if it's a school has one of these things, it's a student one-off doing their own thing as opposed to it being a collaborative classroom activity. And that's, it will get there. It absolutely will get there. There are already some really cool VR solutions that are doing that. And it's just a matter of time before that progresses into the augmented and mixed reality realm.

Like is it just, is it going to be as easy as like filming these things with a vision pro on and then being able to just replicate that? Talk about the creation aspect of creating these types of experiences like.

on the wall that the hardware is gonna continue to improve and improve. And we need to be really mindful to not create content that is tethered to one particular device. And our path forward with so I'll talk about career View XR as an example. And then we can kind of dive into to others. But we create 360 degree media that essentially is, it's not an interactive 3D object, it's an environment that you are within.

So, when that's being accessed on a standard device, it's like a home virtual tour that you can spin the images around and you can navigate and you can tap on hotspots. When it's in a virtual reality space, it's a video that you are within and you are completely immersed in one location, observing what a career is like. Now we start to extend that to. To the augmented or mixed reality arena. The presentation of the content itself, it's still gonna be a video that you're within.

You're not gonna be able to talk to the person that's in the video that we've created, but with a mixed reality. Device.

That is the huge differentiator when we start going into this mixed reality realm. It is digital content in your real world. And I think that the companies that are gonna do really well in that space, so the ones that are ready to like you talked about the. Cooking app where the developer is already figuring out, okay, how do we use spatial?

Within this the companies that are thinking about platform agnostic content that transcends the various pieces of hardware that it's accessed on those are the ones that are gonna be doing the best in the next 3, 5, 7, 10 years.

I imagine, not a developer, but I imagine that they've probably done a lot of that heavy lifting for you, that if you say this is the model and these are the dimensions, then a lot of that, and you have a 3D rendering of it, a lot of the other stuff of what it looks like here is going to be taken care of. What? What do you think there?

infrastructure, the idea of digital objects being positioned in space has been around for years. What Apple's doing is they're creating a new window to see into that.

Arena is 360 video that has action going on within the scenes, whereas a Matterport camera is really more about scanning a a facility a building A home that said scanning with a camera like Matterport, that there's no reason that.

The models that are created through that or through like an enhanced LIDAR scanner or the other hardware technologies that allow you to create a 3D space there, there's no reason that digital media couldn't be brought into the environments that, that we view in a device like Apple, apple Vision Pro. I don't know how true this is. I, someone was telling me the other day that it was, I the. Notre Dame was scanned with Lidar. There was a 3D model that was created of it for the video game.

I think it was Assassin's Creed, maybe that, that I am, this is like third or fourth hand, but, so someone's gonna have to fact check this. Ask asterisk. But being able to. Have a space like that, that then is used in the reconstruction of the cathedral, if it's that accurate. There are going to be things there, there's going to be digital tourism. I mean, being able to bring the cathedral into your home and feel like you're walking through it or a facet of It's.

Put Michelangelo's painting of the ceiling of the Sistine Chapel on your living room ceiling. These are the kinds of things that are going to be possible. And it's funny 'cause we used to work in travel and tourism. We did a lot of 360 degree photography and video and travel and tourism. And there was a fear in the industry that, oh, if you do that, then people aren't gonna wanna come. And that's not the case at all. What happens is they get a taste of it and.

You know, that someone who's really passionate about that space or that experience, they're gonna wanna go have it in person. It's just like, you know, if you love going to the Smithsonian, you don't go once and you're like, okay, I'm never gonna go again. I've been there, done that. You go again and again. And I think that there's a huge opportunity here to inspire interest in. A world of locations that we've never been able to get access to before.

And do that as not just an immersive virtual reality space, but as change your window. I wanna look out my window and I wanna see Mount Everest in real time. I mean, those things are coming.

But that would be a pretty amazing thing to see and experience and have as part of what you're doing. So Matt, we've just scratched the surface really here. And and obviously that you have a ton more information in your brain that you could share with us. But I appreciate you being here and and if somebody wants to get in touch with you about what you're doing, what's the best place for them to go to, to connect with you personally?

There are gonna be things that are gonna be happening that we can't even imagine and love having these conversations and also getting ideas for how do we make sure that the career view product stays stays on top of all this.