Remember the wooden labyrinth toy that made you rage-quit at age 8? Or watching your ball fly off the edge in Marble Madness on the Mega Drive? Or the Super Monkey Ball sessions that ended friendships?

All three run on one idea: you don't control the ball, you control the world. With Quest 3 hand tracking we could finally do it for real. No controllers, no knobs. You grab the board with your hands and tilt it.

What it does

Sphere is a hand-tracked marble maze that floats in your living room.

πŸ–οΈ Pinch with both hands, tilt, roll. Guide the marble to the goal. Avoid the holes. Don't fall off. Beat your time.

🌍 20 levels, 20 worlds. Wooden toy, ASCII Matrix rain, wobbly jelly, PS1 low-poly, Win95 pipes, Y2K chrome, synthwave…

🌊 Your room transforms. Some levels play in your real space. Others take it over: water floods in, the walls crack and fall into lava, the room pops into bubbles.

🧊 Every world plays differently. Ice is slippery, jelly walls bounce you back, water slows you down. Bumpers, kickers and boost pads are there to wreck your run.

πŸŽ™οΈ Speak a level into existence. "Like level 7 but harder, underwater." Seconds later, it's on the board. The AI runs 100% on the headset, offline.

⏱️ Speedrun-ready: a best time for every level, an instant dissolve-and-respawn, and one more try.

How we built it

Godot 4.7 + OpenXR + Jolt physics, running on Quest 3 with Meta hand tracking and passthrough. Zero textures, zero imported models. Every wall, hole and world is generated in code and drawn by shaders. Tuned physics. Synthesized sound.

Challenges we ran into

πŸ’€ Black screen of death on Quest. An engine bug forced us onto a weaker renderer, so we rebuilt every fade effect by hand. πŸ‘» Ghost marble. At full tilt the ball clipped straight through walls. We fixed it with continuous collision detection and 120 Hz physics. βœ‹ Accidental grabs. Resting your hands near the board would start the level by mistake. 🧠 AI on a headset. Running speech recognition and an LLM in under 10 s without dropping frames.

Accomplishments that we're proud of

People put the headset on and start playing with no tutorial. It just feels like the toy. 20 distinct worlds, not a single texture file. No impossible levels, ever, even the AI-generated ones. Voice level creation that works offline in French, English and Spanish.

What we learned

Game feel beats realism. Perfect physics was boring, and tuned physics is addictive. Hand tracking has to be forgiving, or it feels broken. Test on the headset. Desktop lies. Limits breed creativity. Banning textures made us shader wizards.

What's next for Sphere: Marble Maze

πŸŒ€ Flippers and rotating walls to add more chaos. πŸ† Global leaderboards and ghost races so you can race the world's best runs. πŸ”— Share your AI-made levels with friends. πŸͺ‘ Mixed-reality mazes that spill onto your real table. πŸ›’ Meta Store launch.

Built With

  • godot
  • handtracking
  • shader
Share this project:

Updates