Fit Beat Combat: The MR Expansion

Start here

Inspiration

"Fitness is about freeing not just the body, but the mind." Through operating our VR fitness game Fit Beat Combat, we discovered users weren't just looking to burn calories—they were seeking a way to clear their minds. True wellness requires breaking through mental barriers. We challenged ourselves to use MR not merely to display the room, but to transform it entirely—turning a confined space into a dynamic playground where emotions can be unleashed.

App Overview

This is the "Mind Liberation" update to our fitness game. The experience begins with a floating sphere reflecting the user's room in real-time. Smashing this "symbol of reality" begins the liberation process. A desaturated LUT renders the room as a gray space symbolizing confinement. Players punch notes flying from 360 degrees and destroy the physical walls around them. With each strike, the gray reality crumbles away, revealing a vibrant virtual paradise (Skybox) beneath. This visualizes the journey from confinement to complete liberation.

Technology Used

We integrated Meta Core SDK (OVR Components) into our Unity project.

Scene API: Detects real-world walls so destruction effects align perfectly with physical boundaries, grounding the experience in reality.
Hand Tracking (OVRSkeleton / OVRHand): Leveraged Meta SDK's hand tracking, generating colliders on each bone to build intuitive interactions.
Passthrough Camera API: For the opening, we projected live passthrough footage onto the first "trigger note"—a visual metaphor of "punching through your reality" to begin the escape.
Color Grading (LUTs): Custom LUTs applied to the passthrough layer suppress saturation, creating dramatic contrast between the "confined" gray room and the "liberated" vivid world.

Challenges

Notes weren't responding naturally to hand movements, severely impacting user experience. Older devices couldn't recognize such nuanced motions, but improvements in hand tracking accuracy made this possible. We switched to Meta SDK, generated colliders on each finger, and calculated trajectories from velocity and direction at impact. This enabled not just punches, but free movements like "slapping" and "pushing"—a hand-first approach delivering satisfying, physically authentic interactions.

Accomplishments

A New Form of Fitness: By bouncing notes in 360° and breaking real walls, we achieved diverse physical movements. This fitness experience benefits both body and mind through the sense of liberation from reality.
Balancing Reality and Virtual: Since the experience requires awareness of both worlds, we carefully crafted the art to emphasize transformation while maintaining a sense of reality.

What's Next

This update will be released to existing users in Q1 2026. We will continue incorporating new technologies to create content users will enjoy. We are also exploring:

Shared Spatial Anchors: Local multiplayer where two users can smash the same physical walls together in the same room.
Inside-Out Body Tracking: Tracking elbows and body leaning to enable Elbow Strikes and Body Dodges for a full-body workout.