• 

  Home page

• 

  logo

Sparsh Mukthi -Virtual VR Classroom

Inspiration

• Interactive, hands-on learning is proven to work best but most kids never get it.
• AR/VR can deliver that "actually there" feeling- but headsets are expensive, out of reach for most families.
• Even where VR/AR exists in schools, it's rigid - same experience for every kid, zero adaptiveness.
• We wanted the immersion, without the cost or the one-size-fits-all.

What it does

• No headset. Just fold a phone into a cardboard VR holder you can build yourself.
• Step into a live 3D classroom - real AI teacher, real lesson, real classmates around you.
• Raise your actual hand to ask a question - the teacher pauses, answers, solves it on the board, resumes.
• Phone camera reads your gestures - no controller, no buttons.
• Runs fully in the browser - any phone, zero install.
• OS independent

How we built it

• 3D classroom: Three.js + React Three Fiber
• AI backend generates the entire lesson live - teaching, peer questions, doubts - nothing scripted
• Gesture tracking on-device via webcam/phone camera - nothing leaves the browser
• Designed our own cardboard VR phone holder so anyone can go immersive without buying hardware
• Built with Codex on GPT-5.6 - one setup for app + AI logic, another for 3D/avatar work

Challenges we ran into

• Getting a smooth, immersive VR-style experience running in-browser, on a phone
• Designing a cardboard holder that actually balances a phone properly - early builds kept tipping, took several passes to fix weight distribution

Accomplishments we're proud of

• We didn't simulate VR - we made it genuinely accessible
• A kid with just a phone and a piece of cardboard gets the same immersive classroom as anyone with a $500 headset
• Every lesson is live AI, not canned content

What we learned

• Immersion comes from timing and small details, not just graphics
• Kid-safety can be built into the AI's structure, not bolted on after

What's next

• Lip-synced avatars for true face-to-face feel
• Parent progress dashboard
• Multiple kids joining the same virtual classroom together

Video Link

https://youtu.be/PLkqxBCa92U?si=Rqp9Bcwk9NMWTI2i

"Try it out" links

https://frontend-eosin-nu-67.vercel.app/

Built With

• ar
• mediapipe
• opencv
• python
• three.js
• vr