About the project

Dungeon Magic VR is a 3D roguelike dungeon crawler where players shoot magic from their hands, playable with hand gestures only. Players form different hand shapes to cast spells and fight through a six-floor dungeon guarded by five bosses.

Inspiration

When setting out to build a gesture-only game, I used AI to create a fantasy action game where players cast spells directly with their hands. To bring the fantasy world to life, I gave the characters and stages a comical, storybook look.

What it does

Players delve into the dungeon and battle enemies using hand-cast magic. Whenever they fall, they return to the town camp, spend collected gold and materials at the shop or forge to strengthen their spells, and dive back in. The game features a complete run from opening to ending across six floors, with difficulty options ranging from Casual to Hard.

How we built it

Almost the entire game was generated with AI using the following tools:

  • Game Engine: Godot
  • 3D Models: Tripo, Blender
  • Images: AI image generation
  • Code: Claude Code
  • Music: Google Lyria
  • Sound Effects: Sonilo

Challenges

With Meta Quest's narrow field of view, fitting the UI cleanly within sight and keeping hand-only gameplay comfortable proved challenging. To address this, I refined the UI layout, designed menus controlled by pointing and pinching, and implemented soft lock-on so spells land reliably.

What we learned

Through this project, I gained practical insights into VR game development, particularly in UI placement, hand-interaction design, and effective playtesting.

What's next

Moving forward, I plan to add systems that support longer replayability, refine the game balance, and expand the dungeons. I also intend to introduce magic battles against humanoid opponents and side quests.

Built With

  • blender
  • claude-code
  • codex
  • gdscript
  • gemini
  • godot
  • godot-openxr-vendors
  • google-lyria
  • hand-tracking
  • meta-quest
  • openxr
  • sonilo
  • tripo
Share this project:

Updates

Submission history