The Good Tech Companies - How Mawari is Revolutionizing 3D Content Delivery

Episode Date: September 4, 2024

This story was originally published on HackerNoon at: https://hackernoon.com/how-mawari-is-revolutionizing-3d-content-delivery. Explore how Mawari is revolutionizing spatial computing and XR streaming with innovative 3D split rendering technology. Check more stories related to web3 at: https://hackernoon.com/c/web3. You can also check exclusive content about #behind-the-startup, #luis-oscar-ramirez, #mawari, #spatial-streaming-solution, #content-delivery-network, #frameless-media, #virtual-reality, #good-company, and more. This story was written by: @ishanpandey. Learn more about this writer by checking @ishanpandey's about page, and for more stories, please visit hackernoon.com. Mawari is the world’s first Spatial Streaming Solution and Content Delivery Network. Its mission is to democratize Spatial Computing through cloud streaming technology. Powered by blockchain, it enables a global community of distribution partners to participate in this vision. The company is based in Shibuya, Japan.

This audio is presented by Hacker Noon, where anyone can learn anything about any technology. How Mowari is revolutionizing 3D content delivery by Ashan Pandey Ashan Pandey, Hi Luis, welcome to our interview series. Mowari's mission is to democratize spatial computing through cloud streaming technology. Can you share the story behind Mowari's founding and how your vision has evolved since 2017? Luis Oscar Ramirez. Thank you, Ashan. With multiple patents to our name, over 40 commercial activations worldwide, and recognition as the world's first spatial streaming solution and content delivery network,

it might seem like Mowari is an overnight success. But let's set the record straight. This journey began in Shibuya back in 2017, and it's been anything but easy. What appears to be an instant breakthrough today is actually the culmination of years of relentless R&D, tireless innovation, and unwavering dedication. We envisioned the future before it arrived. Our founding principle was simple yet radical. Framed media, content confined within screens, would evolve into frameless media seamlessly integrating virtual objects that interact with the real world and with you this isn't just a concept it's a paradigm shift in how we interact with both the physical and digital worlds a phygital revolution mawari meaning your surroundings around, in Japanese, perfectly encapsulates

our mission to dismantle these frames and reimagine what's possible. However, the real inspiration came in 2016 with the co-founding of Mutec Japan. This was more than just a digital arts festival, it was a frontier for experimentation with emerging, cutting-edge media. In 2017, we watched artists explore the nascent field of virtual reality, pushing the limits of what was possible. But we also saw the massive challenges they faced, the data intensity, the computing power required, and the difficulty of scaling these experiences. It became clear that the next generation of entertainment needed someone to break through

these barriers. We chose to be that someone. From day one, our mission was crystal clear. To make 3D, spatial computing media accessible to everyone. In 2018, our vision found its defining challenge. KDDI, a telecom giant, had developed one of the first AI-powered digital humans, named Ico, rendered in breathtaking realism using Unreal Engine 4. She was designed to converse in real-time, a digital concierge meant to live in AR glasses and smartphones. But here's the catch. No existing mobile device could handle the immense compute power needed for her real-time, 3D rendering on die-driven interactions. This was a problem screaming for a solution, a perfect use case for spatial streaming.

KDDI put out an RFP to stream ICO in full 3D to smart glasses, a challenge that could have intimidated even the largest tech firms. And it did, except for Mawari, a three-person startup. Against all odds, we won. Competing against major tech players, we, the David in this story, overcame the Goliath of the tech world. This was our, aha, moment. My co-founder Alexander Borisov and I realized we could achieve what others thought impossible. By integrating and adapting several state-of-the-art technologies, we streamed ICO in real-time, in full 3D. But we soon recognized a harsh reality.

The state-of-the-art technology stack and infrastructure was a dead end for our ambitions. We were on our own to solve the latency and bandwidth challenges. With no external help, we had to rethink everything, from rendering to encoding, streaming, and decoding 3D content. Not through traditional means, but through a new, innovative approach. This led to the creation of our core technology, the Mawari engine and its spatial streaming SDK, native to spatial computing and augmented reality. As we began commercial deployment, we saw rapid adoption, but also hit another wall, scalability. Even the most powerful hyperscalers like AWS couldn't help US achieve the scale we needed. The existing data centers and content

delivery networks were not built for real-time, spatial streaming. By 2021, we faced another pivotal decision. Wait for the hyperscalers to eventually catch up or forge our own path forward. We chose the latter. We built the Mewari Network, the world's first and only DEPIN, Decentralized Physical Infrastructure Network, that orchestrates storage, bandwidth, and rendering in real time for spatial computing. Powered by blockchain, it enables a global community of distribution partners to participate in this vision. Our mission has never wavered. We tackle every technical bottleneck head on Torializeit. And our vision? It's crystal clear and as bold as ever, we're not just evolving with the industry, we're defining its path forward. Ashan Pandey, Mowary's proprietary

3D split rendering technology and 3DS streaming codec are tackling significant challenges in spatial computing. Could you explain how these technologies work and why they're crucial for the future of XR experiences? Luis Oscar Ramirez. Why does spatial streaming matter? Think about it. When you press play on Netflix, a 4K movie appears on your TV or smartphone almost instantly. We don't even think about it anymore, it's become a part of our everyday lives. But here's the stark reality. Before Mawari, spatial content couldn't be delivered at scale with the quality and immediacy we've come to expect from services like Netflix or YouTube. That's the elephant in the room. Mowari's technology is making something extraordinary happen. We're bringing that same seamless experience to spatial content. No downloads,

no waiting, no storage limitations. Just like how you listen to music or watch a movie today, effortless, immediate. We're removing the friction, making dynamic streaming of spatial experiences available anytime, anywhere, for everyone. How does it work? As I mentioned earlier, Mowary's technology is designed to be native to spatial computing, a field that presents unique challenges and opportunities. First, let's consider the nature of spatial computing experiences. They combine 2D and 3D content. While we've perfected the art of streaming 2D content with efficient technologies and codecs, the same doesn't hold true for 3D. This is where Mewera comes in.

We created groundbreaking technology specifically designed to stream 3D, immersive content efficiently, seamlessly integrating it into spatial experiences using our patented format. Now, let's get to the core issue. If you want to stream an entire spatial experience, you're dealing with more than just 2D and 3D content. You're also dealing with spatial computing elements, the real-time calculations a device performs to position both you and the content in the real world. Because these devices essentially act as a

viewport for your eyes, they demand ultra-low latency. Streaming these elements over a network makes them highly susceptible to delays. When there's a hiccup, you don't just get a buffering icon. You get screen lock, and that's not just annoying, it can lead to motion sickness and a subpar experience. With 2D content, buffering is just an inconvenience. But in spatial computing, it's a critical problem that affects the user physically. That's why we believe that certain elements must be processed or rendered directly on the device. The spatial computing calculations and basic 2D elements like UI components, buttons, menus, and the like. And this is where our split-rendering technology makes a difference. We enable these critical elements to be rendered on the device itself, while the rich, dynamic 3D

content streams from the Mowari network. Think about it like this. With Netflix, you download the app framework, but you stream the content. We're applying the same logic here, removing friction and delivering a seamless experience. This approach eliminates the traditional obstacles, no downloads, no storage issues, just seamless, real-time streaming. To sum it up, we stream 3D immersive content into a spatial experience running on a device equipped with Mowary's split rendering technology. This is how these two technologies work hand-in-hand to create a flawless user experience. And there's another game-changing aspect of our split rendering technology, context-aware streaming. This feature, called Occlusion, lets you place streamed content

precisely within the real world. Imagine an AI assistant sitting across from you at a table. You'd expect to see only the upper half OFITS body, just like a real world. Imagine an AI assistant sitting across from you at a table. You'd expect to see only the upper half OFITS body, just like a real person. If we streamed the entire experience, achieving this level of contextual realism would be impossible. It would feel like an outdated overlay, reminiscent of the old Vue master toys, a far cry from the immersive future we're building. Ashant Pandey, the Mawari hashtag DEPIN network leverages GPU-powered nodes for efficient real-time 3D content streaming. How does this decentralized approach differ from traditional content delivery networks, and what advantages does it offer? Luis Oscar Ramirez. Mawari network was a DEPIN from its inception as centralized approaches and traditional content

delivery networks were not suitable to scale our spatial streaming solution. This is what I have defined as a purpose-driven DEPIN. More specifically, traditional content delivery networks distribute content across its nodes. This content does not require compute after the initial source has been processed. However, when it comes to real-time 3D streaming we need to distribute the compute and storage, source file, across the nodes of the network. This means that we need a fairly distributed fleet of GPU nodes with proximity to the end user to ensure optimal round-trip latency to the end-user device. On top of that we can interact with programmable last-mile networks to guarantee COS. This orchestration needs to happen near real-time and it is not something centralized, traditional networks offer today.

More importantly, hyperscalers have invested billions of dollars in its current infrastructure architecture. No CFO in these organizations is going to approve new, purpose-built facilities for spatial streaming until there's a calculable payback period, in other words, enough demand to justify billions if not trillions of investment in this new infrastructure, its classic web2. With a new architecture and using DEPIN as approach, Mowari removes the capex burden by taking advantage of the huge amount of existing GPU nodes across the globe and creating a global community of partners who contribute resources to rapidly scale a global content delivery network that, again, unlike traditional CDN and cloud services, is powered not by paper contracts but by blockchain, a 21st-century

technology to enable a 21st-century revolution in immersive content and experience. Blockchain provides not only trustworthy tracking of performance, but also programmatic management of performance and automatic distribution of fair financial rewards to all partners. Ashan Pandey. You've mentioned that consumers are conditioned to expect multimedia content to be streamed reliably, like with Netflix. How is Mowary working to bring this level of seamless streaming to the XR space? Luis Oscar Ramirez. That's a great question, Ashan. On the technical front, we've built the foundation, creating the technology and orchestrating the resources needed to meet the high expectations of today's consumers.

We're staying laser-focused on continuous innovation as spatial computing devices evolve. But let's be clear, we don't create the content ourselves. That's where our collaboration with developers and content creators comes in. We work closely with visionary artists, IP owners, entrepreneurs, and brands. It's a partnership, a collaboration where we bring our cutting-edge technology and hands-on experience together with their creative vision. Our mission IceClear. To empower developers and creators to craft awe-inspiring spatial experiences that captivate their audiences. Why? Because we believe that a consumer's first encounter with spatial technology should be nothing short of magical. It should create that

wow moment that leads to a ripple effect of excitement and adoption. As for scaling, we see a trajectory similar to that of video games. Remember how video games first gained traction in location-based arcades before moving into the home and eventually evolving into a massive online culture with esports and streamers? We believe spatial computing will follow a similar path. That's why we encourage our partners to initially launch their experiences in IBX, location-based experience, arcades, where people can experience this technology firsthand. Take our XR performance at Mutec Japan, for example. This wasn't just another show, it was a mesmerizing experience. A renowned choreographer, Hiroaki Yumada, teamed up with MXR, a real-time 3D motion graphics tool using Unreal Engine 5.

By integrating our spatial streaming SDK, MXR brought something truly extraordinary to life. A performance that seamlessly synchronized projection mapping, sound, and spatial content in real-time. Case study right-pointing arrow M-A-W-A-R-I-X-M-X-R present. Assimilating XR by Hiroaki Yumada, greater than in the results speak for themselves spatial experiences are ready for prime time, no more gimmicks. Audiences are eager for new, engaging content. This show sold out in less than a day, with a $20 ticket price for a 7-minute performance. 96% of attendees were satisfied, and 71% of first-time users found significant value and said they'd recommend it to

friends and family. This is how you ignite the flywheel effect. You create unforgettable experiences, inspire more creators, and build momentum for the entire spatial computing ecosystem. Ashant Pandey. Mowari has developed both a spatial streaming SDK for developers and the Mowari network for content delivery. How do these two elements work together to create more immersive and responsive XR experiences? Luis Oscar Ramirez. Think of it like yin and yang. The spatial streaming SDK and THE Mawari network are two integral parts of a powerful ecosystem. Without the SDK, content creators and developers can't stream high-quality, immersive content to spatial devices. And without the Mewari network, they can't scale those experiences to reach a global audience.

Here's how it works. The SDK is the tool we provide to developers and content creators, a gateway to unleashing their creativity and crafting awe-inspiring experiences. Over the years, we've learned one key thing. Creators should focus on what they do best, being creative. Our technology takes care of the rest, removing any barriers that stand in their way and streamlining the process. We don't ask developers to change how they work. Our SDK integrates directly with their existing workflows, whether they're using Unity or Unreal Engine. It's a simple plugin, no need to learn new tools or change what's already working. On the cloud orchestration side, it's equally straightforward. All creators need to do is

upload their Unity or Unreal Engine project to the Mowari network. From there, we manage everything on the backend, just as traditional two decontent delivery networks do today. This approach is all about efficiency and empowerment. It eliminates the need for developers to learn new tools or hire specialized staff for cloud streaming, DevOps, or backend management. What once took weeks or months to master and dasto deploy is now reduced to a simple upload. This is how we enable developers to unleash their creativity and bring their visions to life, faster and more efficiently than ever before. Ashan Pandey, The XR industry is rapidly evolving. What do you see as the most significant

challenges and opportunities for spatial computing and XR streaming in the next 5-10 years? Luis Oscar Ramirez, The spatial computing industry is evolving rapidly, and with this evolution comes both significant challenges and tremendous opportunities over the next 5-10 years. Oscar Ramirez, the spatial computing industry is evolving rapidly, and with this evolution comes both significant challenges and tremendous opportunities over the next 5 to 10 years. One of the biggest challenges we face today is the low penetration of spatial devices. While this might seem like a hurdle, it actually presents a unique opportunity. Right now, the market is wide open, a blank canvas waiting to be filled. There's no dominant player, no killer app that's defined the space yet.

This is our chance to break free from traditional monopolies and democratize the creation and distribution of content. It's a moment ripe for innovation, where we can explore new ideas, develop groundbreaking applications, and set the standards for what spatial computing can truly be. This is why collaboration and a community-driven approach are so crucial. groundbreaking applications, and set the standards for what spatial computing can truly be. This is why collaboration and a community-driven approach are so crucial. The future of the spatial industry isn't going to be built by a single company or a handful of players, it's going to take a community. Just like the open-source movement changed the game for software, a community-driven approach will be key to making spatial computing thrive. That's where the Mawari DEPIN network comes in. Unlike other markets where DEPIN networks

struggle against established giants, spatial computing is a blank canvas. This gives the Mawari DEPIN network a rare opportunity to become the standard for decentralized spatial streaming and immersive content delivery. But we can't ignore the issue of monetization for developers. As spatial computing evolves, developers need clear paths to turn their innovations into income. At Mowari, we're not just fostering an ecosystem, we're actively guiding our partners towards effective monetization strategies. This is no small feat, it's a monumental effort that is setting the foundation for a robust, sustainable ecosystem that supports both creators and consumers. By establishing new business models and revenue streams, we are paving the way for a broader, more inclusive spatial ecosystem.

Looking ahead, while there are challenges, the opportunities are even greater. The low penetration of devices, the absence of a killer app, and the need for a collaborative approach, these aren't just obstacles. They're the conditions that allow new leaders to emerge, new ideas to take root, and new standards to beset. Mowari is here to seize these opportunities, to lead the charge, and to shape the future of spatial computing. Ashant Pandey. Mowari has already collaborated with companies like KDDI for AR activations. Can you share some insights from these real-world applications of your technology and how they've shaped your approach to scaling XR experiences? Luis Oscar Ramirez. The most valuable insights

we've gained have come from deploying our technology commercially in over 40 different projects. This real-world experience has been our greatest teacher. It's shown us what truly captivates consumers, what makes them say, wow. It's also taught us how to reduce the friction that often comes with adopting new technologies and helped us understand which business models actually thrive in this emerging industry. Secondly, by implementing our own technology, we've learned what developers need to streamline their processes and unlock their creativity. It's about giving them the right tools to innovate without the headaches. Our early access to 5G networks and their APIs, through partnerships with KDDI, T-Mobile, Deutsche Telekom, and Telefonica, has been a game-changer.

It has allowed us to see what works under real-world last-mile conditions. This experience has pushed us to refine our technology beyond the controlled environment of a lab, addressing the challenging realities of consumer deployment, where there's zero tolerance for errors. Equally crucial have been our collaborations with Qualcomm, Xreal, and MagicLeap. Getting early access to spatial devices has allowed us to understand the finer details that make everything work seamlessly together. It's this deep understanding, born from hands-on experience, that allows us to create harmonious, groundbreaking solutions that redefine what's possible in spatial computing. Don't forget to like and share the story.

Tip Vested Interest Disclosure. This author is an independent contributor publishing via our business blogging program. Hacker Noon has reviewed the report for quality, but the claims herein belong to the author. Hashtag D-Y-O-R. Thank you for listening to this Hacker Noon story, read by Artificial Intelligence. Visit HackerNoon.com to read, write, learn and publish.