Inspiration Everyone has made a shadow rabbit on a bedroom wall. It might be the oldest hands-only game there is: no rules, no equipment, just light and your fingers. Shadowplay asks what happens when that wall can answer back. Mixed reality finally lets us put a lamp in your room that knows what your hands are doing.

What it is Sit down facing a wall and press Start. A small brass lamp glows below your chin and a pool of warm light lands on your real wall. Raise a hand and its shadow appears, huge and soft-edged. A faint outline shows the shape to make. Get close and the lamp hums brighter. Hold it, and the shadow tears free: the rabbit hops away, the seagull flaps up and out of the light, the fish swims off.

Eight creatures go from a fist (Pebble) to a two-handed Butterfly. Every creature you find joins a shelf of silhouettes along the bottom of the light. Each day opens with a shadow of the day that keeps your streak alive. One complete moment takes under a minute, so it fits a bus stop or a coffee break.

How we built it Immersive Web SDK (WebXR): one link, runs in the Meta Quest Browser. Real shadows from real hands: all 25 tracked joints of each hand are projected from the lamp's position onto the wall plane. That's the same geometry as a real shadow, so moving your hand toward the lamp really does make the shadow grow. Your room is the stage: WebXR plane detection finds the wall in front of you, and the light and shadows land on it in passthrough. The lamp sits low so shadows throw above your hands, and slides back for distant walls so the whole pose fits. With no wall ahead, a paper screen in a wooden frame appears in front of you. Matching poses, not pixels: pixel overlap called a fist and "horns" 92% identical. So each hand becomes six numbers: how straight each finger is, plus the direction it points. That works with either hand, at any distance. In tests, a correct pose scores 1.00 and any wrong pose 0.35 or less. No assets to load: creatures are their own captured hand shadows, and all sound (lamp hum, a unique arpeggio per creature) is synthesized live. Hand interactions Hands are the entire interface. Shadows come from live joint tracking, and pose matching reads finger extension and orientation. Levels are authored by holding a pose in the headset. Everything works within a two-foot radius, seated, with either hand, and seven of eight creatures need only one hand.

What's next More creatures, including two-handed duets, plus a "theatre" mode that records your shadow show as a short story you can replay. Then shared shadow shows, where a friend's hands appear on your wall, and a Horizon Store release as a PWA.

Built With

  • immersive
  • sdk
  • web
  • webxr
Share this project:

Updates

Submission history