-
-
Hands only: a punch lands in Monument Valley. Real in-headset gameplay, no controllers.
-
Seated Mode: no ducking, no turning. Every target comes from one portal in front of you.
-
Pause with a left-palm pinch, then set target and floor height with pinch buttons.
-
Any place on Earth, from Street View or your own 360 photo, timed to your own music.
-
Point with your hand and pinch to choose a song. Pinch the arrows to scroll.
-
Your tracked hands are the gloves, inside a real 360-degree place.
Inspiration
Most VR fitness games give you the same studio and the same playlist. We wanted the opposite: punch targets timed to the songs you actually love, while you stand (or sit) inside a real 360-degree place you choose, anywhere on Earth. Then we wanted it to work for people who cannot or would rather not hold controllers, and for people who cannot stand, duck and turn through a full room-scale session. The VR Start brief, hands-first and seated, was exactly what we wanted to build next.
What it does
- Your music, your place. Add songs on boxwherever.com from your phone or computer. Our server listens for the beat and writes a boxing workout for each song: jabs, crosses, hooks, uppercuts, blocks and dodges. Pick any Street View location, or upload your own 360 photo, and the workout happens there.
- Hands-first, end to end. Your tracked hands are the gloves. In the menus you point with Meta's own hand ray and pinch to choose. Turn your left palm toward you and pinch to pause; the pause menu has pinch buttons for target and floor height. Long libraries scroll with pinchable arrows. No controller is ever needed.
- Seated Mode. One switch in the main menu removes ducking and stance changes and brings every target from a single portal straight ahead, so the whole workout fits in easy reach from a chair or an airplane seat.
- A complete round in one song. Each song is a full, self-contained round of three or four minutes, and a ring around the portal counts down to the end of the song.
What is new since the competition opened (Adapted division)
- 0.170.0 (1 Oct): hands-only play for the whole game; Seated Mode; five included songs playable with no account or pairing.
- 0.171.0 (1 Oct): pinch scroll arrows; leave a song that is still loading with the hand menu gesture.
- 0.172.0 / 0.173.0 (11-12 Oct): Undo Miss, which gives back the longest streak you lost; an automatic wider-scene fallback when a location has no full 360 image.
- 0.175.0 (6 Nov): first-run training written for hands, with target and floor height set by pinch-and-hold buttons; a song timer around the portal.
- Studio (website): 240 minutes of songs per household, levelled to one loudness so every song hits the same; My Scenes to save favourite places; multi-song workouts.
The first five minutes
Put the headset on and you are already standing in a real place. A short voiced training teaches each punch with a target you hit, one at a time, and in hands mode every step speaks in hands and pinches, never triggers or sticks. Then five included songs are ready to play straight away, with no account and no phone. In the recording for our video, the first target is punched about 40 seconds after the app opens.
Why people come back
Because the workouts are made from your own music, they never run out: add a song tonight and it is a new workout tomorrow. Change the place and the same song feels new. A weekly goal you set yourself sits beside the library and fills as you box, today's stats (minutes boxed, moves, accuracy and completed workouts) are kept for every member of the household, and Undo Miss saves the streak you were proudest of.
How we built it
One Unity 6 project and one Meta Horizon Store app serve controllers and hands. Hand poses and punch speed come from Unity XR Hands (OpenXR hand tracking); the menu ray, pinch and menu gesture use Meta's hand-tracking aim data, the same signal the Quest home screen uses. Seated Mode re-expresses each song's choreography around the starting direction, keeping the punch pattern and removing the turns. On boxwherever.com a Python pipeline analyses each song's beats, levels its loudness, choreographs the moves and fetches the 360 scene, with a wider-scene fallback so a player never sees a blank or low-resolution place.
Built for a narrow view
In Seated Mode every target arrives from one portal in front of you, and menus sit inside a comfortable forward cone, which suits the narrower field of view of Meta's coming glasses as well as Quest.
Challenges we ran into
Adding hand support at first broke controller song selection: some OpenXR hand-interaction profiles put hand devices on the same input slots the game reads controllers from. We found it in on-device logs, kept those profiles off and rebuilt hand input so the controller path stayed exactly as before. A finger-direction pointer made pinching impossible, so we moved to Meta's aim ray. A clenched fist thrown as a hook can look like the menu gesture, so pause now needs a still hand. And the first-run training still spoke of triggers and sticks to a player with no controllers, so we rewrote every step for hands.
Accomplishments that we're proud of
Hands-first play and Seated Mode reached every BoxWherever owner on the Meta Horizon Store on 1 October 2026, inside the competition window, without changing the controller game our existing players rely on, and we have shipped four more updates since.
What we learned
Hands-first is more than swapping an input source. Every control that lived on a button or stick needs a visible, pinchable replacement, and accessibility works best as its own clear mode rather than a side effect of how someone holds their hands.
What's next for BoxWherever
More seated workouts, voice and high-contrast options, longer-term goals and history, and tuning for Meta VR Glasses once the device is available.
Try it
- Judges' build (Competition release channel): https://www.meta.com/s/5901CqFgz
- Meta Horizon Store: https://www.meta.com/experiences/boxwherever/1738086587225035/
- Website: https://boxwherever.com
Track: Gaming · Division: Adapted / Significantly Updated Experience