Inspiration

We wanted a chess game a family could share: a child who has never played puts on a headset, reaches out, and is moving a piece within a minute, while an adult still finds a real game. In Garden Chess the pieces are living characters on a life-size board in a quiet garden, and a small companion, Claire the hamster, walks with you, shows you what to do, and talks you through your choices in a few plain words.

What it does

  • Play ordinary or timed games against an opponent whose strength you choose, from beginner upward.
  • Learn with Claire's ten short Academy lessons, then a six-chapter campaign with rival characters.
  • Solve puzzles from a catalogue of positions, and three short chess mysteries.
  • Learn from your own games: every move is scored against the best available move, Claire explains in plain words why a better move existed, and you can retry the moment, take a move back, or practise your weakest positions later.
  • Eight garden and plaza surroundings; English, with Mandarin available.

Everything works with hands alone; controllers are optional. Point and pinch to choose a piece and its square, with legal squares glowing on the board. Raise your left wrist for Menu and Help, or use Quest's left-palm gesture. Pinch empty space to go back. Walk around the board, or pinch and hold with your left hand to teleport.

How we built it

Godot 4.7 with OpenXR and Meta hand tracking, characters made in Blender, and an AI-agent-assisted workflow on a Mac Studio. Every build passed automated scene and save-compatibility suites before reaching the headset, and spoken notes recorded during headset playtests drove each round of fixes. Claire's narration is prerecorded and runs offline. Move analysis uses the open-source Stockfish 18 engine (GPLv3) as a separate, unmodified process on the headset, with its licence and source included. The game itself (rules, characters, coaching, saves and VR interaction) is our own work.

Challenges we ran into

Making every interaction work with hands alone on a life-size board, including squares out of reach; explaining chess mistakes so a child understands them without walls of text; and keeping everything (engine, voice, coaching) fully offline on the headset.

Accomplishments that we're proud of

  • A complete game playable from start to finish without ever pairing a controller; all spoken help says "pinch" and "wrist", never button names.
  • A full chess engine and move-by-move coaching running entirely on the headset: no account, network or cloud service needed.
  • Dozens of headset-tested versions since October, with players' saved games preserved across every update.

What we learned

Hands change how people treat the pieces: players reach toward them like real objects, so Claire can teach by demonstration rather than by text. Short, plain spoken guidance works better than menus full of words, especially for children.

What's next for Garden Chess

A seated tabletop mode with a miniature living board, more campaign chapters and mysteries, clearer progress between visits, and a Meta Horizon Store launch with free starter content and a one-time full unlock.

Built With

  • blender
  • gdscript
  • godot
  • hand-tracking
  • meta-quest
  • openxr
  • stockfish
Share this project:

Updates

Submission history