Motley Fool Money - The Dawn of Spatial Computing

Episode Date: February 24, 2024

You’ve probably interacted with large language models. The next version might be large vision models. Cathy Hackl is a futurist, Apple Vision Pro developer, and co-author of the upcoming book “Spatial Computing: An AI-Driven Business Revolution.” Deidre Woollard caught up with Hackl for a conversation about: - How businesses, like Lockheed Martin and Lowes, are already using spatial computing. - The current challenges developing apps for the Vision Pro - Virtual air rights, digital fashion, and questions about the future of spatial computing. Companies discussed: APPL, U, LMT, LOW, META, GOOG, GOOGL Host: Deidre Woollard Guest: Cathy Hackl Producer: Ricky Mulvey Engineers: Rick Engdahl Learn more about your ad choices. Visit megaphone.fm/adchoices

This episode is brought to you by Indeed. Stop waiting around for the perfect candidate. Instead, use Indeed sponsored jobs to find the right people with the right skills fast. It's a simple way to make sure your listing is the first candidate C. According to Indeed data, sponsor jobs have four times more applicants than non-sponsored jobs. So go build your dream team today with Indeed. Get a $75 sponsor job credit at Indeed.com slash podcast. Terms and conditions apply.

Once you start to have these devices that are scanning the physical world in real time, you start to create what I call large vision models, models of the physical world, right, that understand our world and are updated almost in real time. That's where it starts to get really interesting and a little scary. From a privacy perspective, I'll be honest. I'm Mary Long, and that's Kathy Hackle, a futurist, author, and an Apple Vision Pro developer. Dejure Willard caught up with Hackle for a conversation. about spatial computing. They discuss how this technology could change meetings, manufacturing,

and remodeling a kitchen, what the beginning of mobile can teach us about this computing revolution, and the difference between the technology and value in the Apple Vision Pro. Let's talk about spatial computing. This is all about the Vision Pro. Apple wants us to believe this is the future of how we interact with technology. What's your take? So I want to start by saying that I think, we need to take a step back from, we're going to talk about the hype, of course, but not frame the conversation of spatial computing around just one single device. And this is why, because when you start to think about spatial computing, I think a lot of people are thinking of it in the context of only the Applevision Pro or, you know, some people might use it interchangeably with the word mixed

reality. I am of a different mindset, right? I don't think that this is the same. Just like the internet is not the same thing as our mobile phone, right? I don't think special computing is the same as one single device or one single technology. So what I mean by that is that spatial computing is an evolving form of computing that is 3D-centric and that uses technologies like AI, computer vision, mixed reality, and other technologies to blend virtual experiences in someone's experience of the physical world, into a human's experience of the physical world. That being said, through spatial computing, we're also allowing technology, computers, robots,

devices, hardware, to start to navigate the physical world with us. So it's a combination of a lot of new technologies about human-to-human communication, but also human-to-computer interaction. And it is not about one single thing. I would even go as far as saying, this is a new field of technology, and it is as revolutionary as mobile computing has been for all of us. So spatial computing, I think people need to take a step back and realize, like, What we're talking about here is the future of computing, the future of how we as humans will

interact with technology in new ways and not just one device or one single technology or even the metaverse. And I know we're going to get into that. Okay. So I have to ask you, have you played with or used the Vision Pro? And how does that relate to this overarching theory of spatial computing? Yeah. So definitely have used the device.

I mean, I am personally an Apple Vision Pro developer. So I actually had a chance to try the device before many people did. I just couldn't speak about it publicly. Obviously, lots of NDAs and stuff. But now, you know, everything's out in the open. So, yeah, I mean, I had done things with it before. Obviously, when it came out to the public, I went and bought my personal unit and everything. So I've definitely tried the device.

I think the device is magical. I think a lot of people, when they first tried a device, they have this like aha moment of awe of seeing technology in a new way. I have noticed doing their reviews and doing their demos. And I definitely have seen that throughout my career and, you know, in technology when people try these new technologies. So that being said, I think the device, and I've said this before, I think there is $3,500 worth of technology in the device. As of yet, I don't think there's $3,500 worth of value to the regular consumer. There is value there for developers like myself, maybe for enterprises, not yet.

but because it's really early. It is a fantastic product. I think it is doing a lot of great things. It is extremely powerful. And another thing, I think a lot of people don't realize is how much artificial intelligence is being used in this device. So, yeah, I think it's a version one. It is the right product at the right time, to be honest, but it's not a mass market product yet. I love that you made that distinction between the value of it and the value to consumers.

I'm curious though, since you were a developer on this, how does developing for this vary with other experiences you've had before? This one's a little bit different, right? Because obviously it's really new hardware that very few people had access to, right? Even the development process, you have to have a computer that has at least an M2 chip, right? So M3, M2. So I think that in itself prices out maybe some developers from developing for this. if you want to develop using Unity, you have to have a Unity license. So there's certain things, I think, right now that might make it hard to, you know,

for maybe a young kid in their dorm, right, to develop for this. They could still develop using, you know, some of the, some of the native, let's say, AR kid or some of the native Apple, Apple, part of the Apple ecosystem. But if you want to develop something really robust, you're going to need certain capabilities, right? So I would say that. I will say, though, because the device is so amazing and truly blends that physical world and virtual experience together, the possibilities of what we can develop are truly mind-blowing. So as a developer, it is both an exciting challenge and an opportunity, right, to start to create experiences that have never been created that no one's really thought of and that take full advantage of that value that is in the device, in the technology within the device.

And I think once we have more developers creating amazing content, we'll get to that point where there is going to be more value for the consumer, for the mass market. We're just not there yet with that part. But that's where the work of someone like myself at spatial dynamics comes into play. We need to create this content. We need to push the limits of the hardware and the technology and truly create mind-bending experiences. Oh, fantastic. Well, I'm curious about that because thinking about like when the iPhone came out and there was not a lot of development, you know, I mean, You had a few cool things you could do, but it was really two years later that ecosystem developed.

Do you see a similar timeline happening here? 100%. 100%. This is version one. And I would say this is like the beginning of mobile. It's really early. First of all, there might be a lot of apps available for the Vision Pro. That doesn't mean that discovering them is easy or that finding them is easy within the

Vision Pro ecosystem when you're wearing the device. And that doesn't mean that all these apps are using the vision. full capability of what the device can do in spatial computing. So I want to be very clear about that. It is early. We're all testing and learning, even with the companies that I'm already working with, the early adopters, it's about exploring the potential of what this can become, right? And it is about what are the early learnings that you can start to take when you're creating

these new apps and new experiences? Because if you look at spatial computing from the perspective that it is the evolution of computing and that it is what comes after mobile computing and you start to think about, it's not about just the device, but it's about every surface or the physical world around you're becoming a spatial interface. Then it starts to get interesting. Another thing I've noticed with the companies I'm working with is that they're also thinking long term, right?

They're starting to, and I tell them, I tell them this. This is, when you start to think about like an iPhone 16, an iPhone 17, a Vision Pro 2, a vision pro three and other hardware that the ecosystem is going to throw at us, then it starts to get more interesting, right? Especially when you start to think about iPhones with more spatial capabilities, more spatial video, maybe some other things you might be able to do with the phone that you couldn't do before. That's where I think the companies and the mass market and more brands are going to be like, okay, so now maybe it's something we should pay attention to. And yeah, that's, you know, that's when you start to not be only about 400,000 headsets being sold,

but about millions or billions of people with these devices at hand, right, that start to have these spatial capabilities. So, yeah, it is, I mean, a lot of us are playing the long game here. That long game is moving really fast, though. So I do have to say that, you know, when people ask me, like, do I put it at five to 10 years, I can't tell you, I don't think anyone really can tell you. I would have to have a vision into every one of these companies' roadmaps to truly tell you. Is it five years from now?

Is it 10 years from now? I think we'll have to see. And there's a lot of different parts that have to fall into place. This is the other part, which I think is interesting and people forget, is spatial computing has four components. It has the hardware, which obviously we as, you know, tech business people, we love overindexing on hardware, taking it apart, talking about all the stuff. There's the software. The software is where there's going to be a lot of work that needs to be done to create this content and create value and experiences. The connectivity, right? When you start to think about all, these devices, if everyone's going to end up wearing glasses and all these devices, you know, connecting

on edge and the types of connectivity we're going to need, it's another level, another level of, you know, of not even 5G. I mean, we're going to need 6G and whatever comes next. And then there's also the part of the data, like all the information that these devices need to operate because they're literally scanning the physical world almost in real time. And then all the data they are, they are going to produce. And that obviously has a lot of implications. So, so yeah, long answer, but that's what I think right now. Well, as someone who invests in data center reads, I'm like, okay, I see something happening here that I'm interested in. Well, and I also want to talk about so many people focus with spatial computing on the consumer aspect, like games and videos and

things like that. But there are a lot of business applications here, too. I mean, I feel like, like people are ignoring a little bit of that part. But with spatial computing, I mean, thinking about for me from the real estate aspect, I mean, you have tremendous capability for business digital twins building information modeling. Talk to us a little bit about some of the business applications. Yeah, I think that that obviously a lot of people want to focus on consumer because that's, you know, a little bit more exciting to talk about shopping and all that. But I think from the business perspective, there's already use cases that have astonishing results. So I'll give you an example. Lockheed Martin, for example, used the Microsoft HoloLens, which is, in essence, a

spatial computing device. And they achieved a 93% reduction in costs on the creation of one part of the manufacturing process for their Orion Space Vehicle. That's a 93% reduction in cost because they use spatial computing. So there's already a few use cases out there that show you that this technology can be extremely powerful. So spatial computing plus AI, you're starting to to talk about revolutionizing a lot of different processes, right, whether it is manufacturing, whether it is real estate. With this technology, right, you can actually put the device on and show someone in the physical world what that is going to look like, right? What that building's going to look like, where the exits are going to be, you're going to be able to walk through

a virtual building, really, not in virtual reality, right? But in the physical world, seeing everything around you. That to me is extremely powerful. It's also going to allow you to tour, you know, a place that you might not be able to go. You can still, you can do that in virtual reality and there's the Zillow app already in the Vision Pro. But right now it's more like 360 photos that you're walking around. So it's, it's not that sense of presence just yet. But when we start to think about that, I think real estate from, you know, from decorating your house and Lowe's is already doing that in their Vision Pro with the kitchen, they have a kitchen demo where you can decorate your demo, but actually seeing what something could look like in the physical world, I think is really exciting or

understanding, you know, from a construction perspective, what the physics of the space could do to the design, the physical design of that house. So yeah, I think there's a lot that's about to be impacted. And because of the devices, but because the physical world becomes a spatial interface. The physical world becomes where we see technology. We no longer have to see it. and these little rectangles that we carry around with us or on our computers, it starts to be all around us. So I think that that opens up opportunities for real estate, for finance, for education, manufacturing, of course, HR, like, you name it. Just like mobile computing has impacted most industries, I believe spatial computing as the, you know, the evolution of

computing, a future compute, will impact almost every industry. Well, I want to talk a little bit about this co-presence idea because everybody wants a better, a better meeting experience. And, you know, when, when Meta first debuted some of the meeting experiences with, you know, the guys with the legs, that, you know, everybody loved to make fun of that. But it seems like we are getting to a place where maybe we're getting closer to that. I was looking at what Google's doing with Project Starline. It feels like we're getting closer to actually making these remote meetings feel a little, a little more like we're really together.

I will tell you, I had a demo of Project Starline last year at the Code Conference. And I was blown away. So you're sitting in front of someone. You're not wearing a device. It's done through AI and cameras. And you're seeing someone through a screen. But the screen is kind of showing you a version of them in 3D. And I was so impressed by the fidelity.

They even looked like I could see someone's pores more than I would normally see them in person. I was like, wow, this is crazy. Or I remember the person I was doing the demo with had an apple. And I literally just wanted to grab the apple from them. Like, because they moved the apple forward. Like they were giving me the apple. Of course, I couldn't grab it. But those sorts of things.

I was wearing something that really stuck with me in the presence part was the poorest. But also I was wearing this ring. And you could see the detail on the ring. He could see the detail on the ring in such a way that was even better than eyesight. Like I don't know how to explain it. The detail was. so clear that I said, okay, this could be really powerful. From a presence perspective, right now, for example, with the Vision Pro, you can use your

personas, which is kind of like a 3D representation of you. It's starting to get a little better. The first couple of weeks, very uncanny. It's still very uncanny. But it's starting to get a little bit better. I think they're starting to improve that. So I think we're start to get a little bit more, you know, better, you know, more high fidelity, let's say of how we look in in these devices.

But the idea of presence, I think that's where it starts to get interesting. That's where it starts to also become something of value and of interest to the mass market. Because one of the most powerful things I've been able to do in my device is look at the video I took during the holidays with my parents. My dad's turning 80 this year. He's getting older. He's very healthy. But I was like, I'm just going to shoot as much as I can on my iPhone so I can have these facial videos of him. you know, reading Lama Lama Red Pajama to my kids, stuff like that.

That's special. And when I put the device on and I can see this experiences in 3D in spatial video, it's powerful. It's powerful. And I'm like, is this the future of the family photo? Is this the future of how we might retain some of those memories? So that's where that idea of presence in real time, but presence also after the fact, I think could be very powerful and could become, you know, could become one of the reasons that, you know,

someone like my dad might eventually in a couple years get one of these devices. Just like back in the early mobile days, you know, my dad wasn't on Facebook. But he got on Facebook because that's where he could see pictures of his grandbabies. So I think it's almost similar right now. But that idea of presence, I think, is going to be huge for human communications, both in the personal side but also the business side. Well, you had mentioned AI earlier. And I'm curious about how much you think as spatial computing evolves,

how much of it is going to be about co-presidents looking at memories, person-to-person communication versus person-to-a-I communication and collaboration. Does this get us deeper into that? Because I feel like we went through the last year of gendered AI, people and co-pilot, things like that. People are getting more integrated with AI. It seems like spatial computing takes that to a whole other level. A hundred percent in the sense that anyone that's working with a chat GPT,

or co-pilot or Claude or whatever it is that you're that you're using, right, from that perspective. We're all engaging with it on our phones or our computers, right? That's where you're engaging with AI. So when you start to look at all these AI companies, they're all looking for that container, what I call a container, of where they're going to put their AI technology. And that comes in the form of hardware, right? Whether it is the R1 Rabbit that took over CES, whether it's the humane AI pin that a lot of people are curious about, whether it's the Vision Pro or whatever Open AI and Johnny I've decided to create

and bring into the world, right? It's all containers for how we engage with AI. So I think that that's where this interesting conversation starts to happen about, you know, it's about engaging with technology in new ways. And the other part here that is important part of the conversation, I think a lot of people are not having this conversation or understanding it, is that right now a lot of the AI, the generative AI that we're talking about is large language models, trained on language, right?

Even when you look at something like Sora or runway, it's trained to, on video, but it's video of things that have already happened, right, or photos of things that have already been created or happened. Once you start to have these devices that are scanning the physical world in real time, you start to create what I call large vision models, models of the physical world, right, that understand our world and are updated almost in real time. That's where it starts to get really interesting and a little scary from a privacy perspective. I'll be honest. But I see the evolution of what comes after large language models as large vision models, models that truly start to become world builders that truly have understanding of the physical world. We're not there

yet. Like, I don't want people to get too too excited. It's the beginning of it. But these devices are going to start to create these models of the world. They're going to start to understand our world so that we can engage with AI in totally new ways in ways that are going to feel seamless. Right. So there is, I think, this evolution. I think a lot of people are not understanding what these devices can do when they're reading the physical world around us. I think that's really fascinating because it makes me think of the difference that happened when we had mobile devices and all of a sudden you could see where everybody was, but you're just seeing that point on, you know, you're seeing a dot.

Now you're seeing all of this information that, and the computers are all processing and layering all that information. There seems like so many applications for that. we're accessing that data layer. Like the data layer is, we can't see it as humans, right? Like, but there's all this data around us. But once you have these devices that we can use to see through glasses, hopefully, like very nice glasses in the future. And they're reading the data that we can't really see, you start to access these new data, this new data layer.

So that's when I talk about virtual experiences in someone's experience of the physical world. that's where it starts to get interesting. You start to see all this data, right? Not on your phone in a little pin, but actually in front of you in the way of an annotation, a hologram or whatever it is that you're going to be accessing. So yeah, it starts to get really interesting, really fast. And that's where compute power, processing power,

where connectivity at levels we've never seen were edge, cloud, like that's where it starts to get interesting when you talk about spatial computing in the perspective of, you know, AI chips. or cloud computing, you know, all these sorts of things that need to be in place for us to be able to kind of truly access that data layer in the physical world. Interesting. And, you know, it is. My mind is going so many places. Because like you mentioned that you have children. I'm assuming young, youngish children. And I feel like for young people, their experience of the physical self and the virtual self is much different than for me growing up because they're growing up playing in Fortnite in Roblox. and they're, you know, they're dressing their avatars.

They're thinking about that. So as we look to a spatial computing future, it seems like there's a place, there's a sort of a consciousness that exists in two places. Does that, do you see that kind of thing happening? 100%. So my three kids are all Generation Alpha. And I've been doing a lot of research and work on Generation Alpha. So that's, you know, the kids of millennials being born 2010 and still being born.

So Gen Alpha is in the process of growing up, let's say. They, and I always say this, to them, what happens in the virtual space is equally real. My kids don't make a differentiation between the real world and the virtual world. It's just different parts of the world. It's a spectrum to them, right? Whatever, like I always say this. Like, if they fight with their friend in Fortnite and they see them at school the next day, they're still going to be mad.

It doesn't change because it happened in Fortnite. It's still an interpersonal relationship. So these spaces are social spaces. And they don't, you know, they fluctuate between them. It doesn't make a difference, right? For them, like they just flow between them. It's very natural for them. So, yeah, that is a difference that I think for other mindsets, you know, millennials and up probably.

It's harder for us to wrap our head around, but I see it with them day in and day out. That's when you start to think about spatial computing and gaming or even fashion. It unlocks a new world of self-expression. It unlocks new opportunities for them to social. socialize in new ways. So, so yeah, like for this younger generation, Gen Z and Gen Alpha, mostly, because Gen Alpha is really who's growing up with this being ubiquitous is truly changing the way they interact. Well, I think the fashion question is interesting because I know you've invested in, in some virtual fashion. So it's sort of, it's at now it's like Fortnite skins and things

like that, but it seems like it's really going in, it could go in whole new places and really be valuable to people. Yeah, I think it's about to unlock a new era for fashion, right, for fashion and luxury and retail in the sense that when you start to have a way for you to see fashion in new ways, right, where I'm going to be able to kind of walk around and if you're wearing your glasses, you're going to be able to see the outfit I want you to see on me, right? Or I might be able to change my outfit depending on, you know, if I'm going into this store right now or this office for this meeting.

you know, maybe I'm meeting my friends for coffee, but then I'm going to go have a job interview. Virtually, I might be able to change the way I look, right? So I think that there's going to be some interesting things there. You already have, for example, at London Fashion Week, a lot of a partnership they have with a company called Psyche, who I'm a big fan of, and I'm a holder of their, of their NFT. And we can talk about NFTs for sure. But I'm a member of their community. I think they're starting to unlock fashion in a mixed reality sense, where there's a fidgetal.

I don't like that word too much, but there's a physical expression of fashion, and there's a virtual expression of fashion. And those expressions are starting to collide and get closer together. So definitely a lot of the conversations I'm having are with fashion brands that most of them are at the forefront of pushing these technologies, right? They've experimented with augmented reality and AR trions for a long time. And now they're like, what comes next? Like, what does this mean? If this is already proving to be a way for us to create, you know, create sales and create engagement with our community, what does this mean when you start to unlock this?

So yeah, I think we're about to see kind of a fashion and technology coming closer together than they have ever been. Let's talk a little bit about NFTs as we wrap up because, you know, we had the NFT hype. We had the Metaverse hype. Now I'm hearing, you know, maybe Metaverse real estate suddenly is becoming valuable again. So you've sort of covered, you've been part of an integral part of all of these movements. Now you're looking back on what. came before and what is happening now. It feels to me like there is, like there's a way that all of

this sort of what happened before sets up what happened now. But what are you seeing? So I definitely see there was definitely obviously a lot of hype, right, over a lot of these NFT speculative assets. Let's be, let's be honest, they were speculative assets. I mean, I got into a lot of these as a speculative asset. I'm not in most of them anymore, to be honest. I've divested myself from that. But what I do think it did prime. the market and the business world to understand that you can still own virtual things, right? That there is something that you could own virtually.

It's in the code, right? So I think it did change the mindset a little bit in that sense, right? It was overhyped and everything. When it comes to real estate, you know, I don't know if I would go back and invest in some of the virtual real estate. I don't know if I would personally do that again. It looks interesting. It would have to be a really good value proposition for me, for me to get back.

in there, we'll have to see why I think it starts to get really interesting in that perspective is virtual air rights, right? And stay with me here for a second. So when, yeah, when everything you can see and everything you can hear becomes real estate, then that's where you start to figure out, okay, well, what is, you know, should people be able to own this? Should a company be able to own this? What I see and what I can hear. Can they own the space around me? Can they own the space on top of my house, right? Can they own where I live, right? So in the virtual space. So I think that that's where you start to get really interesting conversations as far as like, who owns the virtual layer that is on top of the physical world that is, that you're able to see

through spatial computing, right? So a lot of the conversations around virtual real estate that were had, I think are going to be very valid when you start to think about virtual air rights. I think there's, I can remember which country it is right now. There's a country in the Caribbean that already has certain laws related to virtual air rights. Like you own the virtual air on top of your house up until a certain amount, a certain height, right? So I think we're going to start to have these really, I know, like it keeps me up at night. It doesn't keep anyone else. Most people, doesn't keep most people up at night. It keeps me up at night because I really tried to think about like this becomes real estate. It's not just like a floating billboard in, you know,

in Times Square that you're seeing. It starts to become like everything around you. So once I said, exciting for some things, a little nerve-wrecking in other senses. So, so yeah, I think some of the conversations around virtual ownership start to become really relevant, right? And the role of blockchain when it comes to, you know, what you might be seeing. And if it's real, if it's an authorized thing, it starts to kind of seep into this conversation of the future of spatial computing. Wow. Well, thank you so much for your time today. This is so, this is so fascinating. where can people keep up with you because you're going a million places? I am.

So definitely on LinkedIn, Kathy Hackle, H-A-C-K-L, that's kind of where I share a lot of this content. You know, if people want to reach out to me, they can also do that by email at Kathy at spatial dynamics.io. And I have a new book coming out pretty soon. It's called Spatial Computing and AI-driven Business Revolution. They can find out at spatial computing book.com. And yeah, I like to share a lot of information and valuable content on where I see this going. So happy to connect with anyone.

Fantastic. Thank you so much. As always, people on the program may have interests in the stocks they talk about. And The Motley Fool may have formal recommendations for or against, so don't buy ourselves stocks based solely on what you hear. I'm Mary Long. Thanks for listening. We'll see you tomorrow.