TogetherVerse

Inspiration

In contemporary society, many families and friends are separated by distance and life circumstances, making it increasingly difficult to stay emotionally connected and preserve shared moments. While traditional video calls provide a bridge, they often fall short in fostering truly meaningful connections. This is where the dialogue between objects and the real world comes into play, offering a powerful way to deepen emotional bonds. By embedding meaningful objects into shared spaces, physical distance begins to fade, transforming fleeting interactions into tangible moments of togetherness that enrich relationships in ways beyond what traditional communication can achieve.

What it does

We offer a multiplayer co-presence XR platform. This solution empowers loved ones to collaboratively create and enhance 3D memories in real time, fostering meaningful connections and togetherness, regardless of distance.

How we built it

Our platform combines AI-driven spatial augmentation and a multiplayer XR interface to enable users to collaboratively create co-presence experiences. After scanning a physical room, the platform offers two interfaces: an immersive XR view and a miniature virtual room. It also seamlessly integrates image-to-3D generation and voice-to-texture for dynamic interaction. This innovative approach bridges physical and virtual connections, offering families a deeply engaging way to relive memories, far exceeding the capabilities of traditional tools.

Challenges we ran into

Co-presence presents one of our biggest challenges. The Auto Matchmaking feature requires Photon Fusion 2, and enabling networked avatars for multi-user interactions necessitates building an app on Meta Horizon while utilizing the Keystore Manager. Additionally, a stable and fast internet connection is essential for users to see each other's movements in real-time. The AI-based model generation from a single image also currently takes a lot of time, which could be optimized in future iterations.

Accomplishments that we're proud of

We built meaningful bonds with the community and got excited about exploring new technologies together. Beyond that, we explored and implemented new VR technologies like Co-presence and ShapeXR, integrating them seamlessly into our project. We also utilized AI-driven generation to enhance our workflow, boosting both efficiency and outcomes. Additionally, we developed a unique mechanism that seamlessly connects with storytelling, delivering an immersive and engaging user experience.

What we learned

We learned how to work together as a team, combining our skills to solve challenges and create something meaningful under tight deadlines. We discovered new ways to tackle problems creatively and gained a deeper understanding of the incredible potential of XR technology. Exploring tools and innovations from sponsors inspired us to think bigger and showed us what’s possible with cutting-edge technology.

What's next for TogetherVerse

Our future development will focus on delivering a seamless co-presence experience, enabling users to feel truly connected across distances. By integrating multimodal elements such as soundscapes, animations, and tactile feedback, we aim to enhance emotional expression and provide a stronger sense of togetherness. Additionally, we will refine our target audience, improve the product-market fit, and develop a robust go-to-market strategy to ensure the program’s commercial success.