Ouron VR

AI-powered VR learning platform that generates personalized courses with a 3D classroom environment, voice narration, visuals, and interactive quizzes, transforming any topic into an immersive lesson.

Comment

Inspiration

Education has remained largely unchanged for decades with static textbooks, passive video lectures, and one-size-fits-all courses. I believed the immersive potential of VR, combined with generative AI's ability to create personalized content on-demand, could revolutionize how people learn. What if you could type any topic and instantly be transported into a 3D classroom with AI-generated lessons tailored to your level? That vision became Ouron.

What it does

Ouron is an AI-powered immersive learning platform for Meta Quest and WebXR browsers. Users enter a topic (like "Quantum Physics" or "History of Jazz"), select their preferred depth and expertise level, and our custom AI agent generates a complete curriculum with:

  • Multi-module courses with structured slides and visual descriptions
  • AI-generated voice narration using Gemini TTS for each slide
  • AI-generated educational images matching slide content
  • Interactive quizzes with explanations to reinforce learning
  • A 3D virtual classroom environment for true immersion

The entire experience, from course generation to completion, happens in VR, making learning feel like stepping into the future.

How we built it

  • Frontend: Meta Immersive Web SDK for WebXR, TypeScript, Three.js
  • AI Backend: Modal-hosted FastAPI with a custom AI agent for curriculum generation
  • TTS: Gemini 2.5 Flash Preview TTS with custom voice (Umbriel)
  • Image Gen: Gemini 2.5 Flash Image (Nano Banana) for educational visuals
  • Caching: IndexedDB for offline asset persistence
  • Hosting: Cloudflare Pages for global edge delivery

Challenges we ran into

Building for VR required completely rethinking traditional web UI paradigms. The Immersive Web SDK offers powerful spatial UI capabilities, but designing intuitive interactions for 3D space, where users point, grab, and gaze instead of click, demanded creative problem-solving. Orchestrating multiple AI model calls (text, TTS, image) in a real-time pipeline while maintaining smooth VR performance was also challenging, requiring careful asset prefetching and caching strategies.

Accomplishments that we're proud of

  • First VR app: This is my first time building a VR/XR application of any kind
  • End-to-end AI pipeline with custom agent: Creating a custom AI agent for generating an entire detailed curriculum at different expertise levels and levels of detail
  • Production deployment: Working on Meta Quest 3 via Cloudflare Pages

What we learned

We learned that building for VR requires rethinking traditional web UX patterns, everything from button sizes to text readability needs reconsideration. We also gained deep experience with creating interactive experiences with AI-driven multimodal capabilities, and the challenges of orchestrating multiple AI calls in real-time.

What's next for Ouron

  • Custom 3D asset generation: Generate topic-specific 3D models using open-source models like SAM 3D
  • Collaborative learning: Multiple users in the same virtual classroom
  • AR mode: Learn anywhere with pass-through mixed reality
  • Voice interaction: Ask questions and get AI explanations via speech
  • Content marketplace: Share and discover community-created courses

Built With

Share this project:

Updates