Xplore | Virtual Companion for Guided Experiences

A compact XR solution that transforms static exhibitions into engaging, interactive experiences by overlaying AR-based contextual guides and real-time suggestions for a personalized journey.

Comment

About the Project

Inspiration

The idea was inspired by the need to transform static exhibitions into engaging and immersive experiences. Traditional experience centers often lack interactivity, leaving visitors with a passive experience. By leveraging XR technologies, this project aims to make learning and exploring dynamic, fun, and memorable.

What We Learned

  • Leveraging XR tools like ShapesXR to create immersive experiences.
  • Incorporating Meta LLaMA for AI-driven user interaction in XR environments.
  • Applying IDEO’s design principles for user-centered experiences.
  • Overcoming the challenges of cross-platform development for Android and VR.

How We Built It

This project was built using:

  • Meta LLaMA for AI-powered interactions.
  • ShapesXR for real-time prototyping and 3D modeling.
  • Kotlin and Jetpack Compose for developing the mobile app.
  • FastAPI for backend APIs and data handling.
  • AWS for cloud hosting and resource management.

The workflow included prototyping in ShapesXR, building the frontend with Kotlin, and integrating the backend for seamless interaction between the user and the XR environment.

Challenges Faced

  • Integrating real-time AI-driven XR interfaces using Meta LLaMA.
  • Ensuring smooth cross-platform performance on mobile, VR headsets, and PC.
  • Optimizing 3D assets for a lightweight and responsive application.
  • Managing time and resources effectively within the project deadline.

Despite the hurdles, the project brought valuable insights and a working solution that showcases the potential of XR technologies in creating engaging and interactive experiences.

Outcome

The project successfully demonstrated how XR can enhance visitor engagement in experience centers, paving the way for broader adoption of AR/VR technologies in similar domains.

Built With

Share this project:

Updates