Blog

Shape thoughts and news.
shape twitter imageshape linkedin imageshape instagram icon
Scroll down
July 6, 2022

Showcasing The World’s First Multiplayer Mixed Reality Experience at AWE

The Challenge:

We were invited by Augmented World Expo, the world’s number one XR conference and expo,  to showcase a never-before-seen XR experience at the Playground, a 20,000 sqft experience center. We were one of the 20 companies selected for this opportunity to demonstrate the most innovative tech in XR to  6000+ attendees.

The Solution:

It had only been a month since we unveiled the world’s most spatially accurate mixed reality experience at TED 2018 and we wanted to push the boundaries of our mixed reality framework and prove why spatial data is necessary for multiplayer mixed reality experiences.

First, we built a 6-foot tall physical replica of the empire state building and we programmed a virtual cat to interact with it. The cat is spatially aware so it understands the geometry of the building and can jump from ledge to ledge.

The players have to work together to build a virtual barrier around Kitty Kong before it goes on and destroys the world. The players are synchronized in real-time and can see what each other is doing. They are operating in the same frame of reference and this is possible because they are on a shared coordinate system.

By capturing the spatial data of this environment, we can also achieve things like occlusion, which is hiding virtual objects behind physical ones, and collision, which is colliding virtual objects with physical objects and casting of virtual shadows onto the real-world environment. All these things make the experience so much more immersive and believable.

The Results:

Kitty Kong turned out to be the first true multiplayer mixed reality experience the world has seen. Industry professionals were amazed by the seamless tracking, level of immersion and believability of the experience. Many recognized Kitty Kong as one of the first demonstrations of the AR Cloud, a machine readable, 1:1 scale model of the world. The AR Cloud is a proposed operating system for the spatial era and it will enable people to have shared AR experience.

The AR Cloud will add digital context to our physical world

As Augmented Reality devices become more ubiquitous, we will have the means to access information at its origin, whether it’s learning the history of a place or immersing ourselves in a multiplayer role-playing-game (RPG) in the real world.

In order for mass adoption of AR to occur, AR content must persist in the real world across space, time and devices. Persistence means that someone can create an AR experience in a physical space today, come back tomorrow and interact with it. Another user can also collaborate with it on a different device.

For example, an artist can place her 3D virtual art in a plaza for the community to interact with it, regardless of which device they use. The 3D virtual art will “live” in that space as if it’s really there and will not disappear between different app sessions. To enable such a streamlined experience, the AR Cloud is required.

Just like how the Internet was able to connect people through the web, we need a software infrastructure that can enable everyone to have a shared AR experience. This software infrastructure, commonly known as “The AR Cloud”, will become the single most important software infrastructure in the history of computing, far bigger than Google’s search index or Facebook’s social graph.

The AR Cloud will enable everyone to have a shared experience and become the operating system for applications in the spatial era.

Interested to learn more? Check out our Managing Partner, Alex Chuang’s talk on The AR Cloud below.


Thanks for reading!
If you enjoyed reading this article, give it a share.

Up Next

Why the Mass Adoption of Apple Vision Pro is Inevitable

As Apple's Vision Pro makes its debut today, it garners a mix of excitement and skepticism. Questions are raised about its pricing, wearability, battery life, and practical applications. This pivotal moment prompts an important question: Will the Vision Pro redefine our interaction with digital info

Read More

Evolving Brand Integration in the Metaverse with The Sandbox

The Sandbox is an Ethereum-based decentralized gaming platform that merges the exciting worlds of Play-to-Earn, non-fungible tokens (NFTs), and user-generated content. It empowers players to create, own, and monetize their gaming experiences while providing a playground for developers, artists, and

Read More

Using Augmented Reality For Live Broadcasting and Sport Events

XR Media Group, a pioneer in developing award winning XR experiences has involved us to co-develop an advanced Augmented Reality app for Rampage, a world renowned freeride mountain biking competition.The SolutionRampage is an invitation-only freeride mountain bike competition held near

Read More
← Back to articles