MetaPhysical

Inspiration

We wanted to create a game that blends fitness and gaming in a way that feels fun, engaging, and immersive. Traditional workouts can feel repetitive, so we designed MetaPhysical to turn movement into an interactive adventure.

What it does

MetaPhysical is a motion-based obstacle course game where players use real-world movements—jumping, dodging, punching, and ducking—to navigate challenges. The game promotes exercise through gameplay, making fitness both entertaining and rewarding.

How we built it

We used: Three.js for rendering a dynamic 3D environment. TensorFlow.js & Mediapipe for real-time body tracking and gesture recognition. GSAP/Tween.js for smooth motion-based animation. Web-based, allowing players to jump in instantly with just a webcam.

Challenges we ran into

We had issues with: Optimizing pose detection for low-latency tracking. Balancing difficulty to make gameplay both fun and physically engaging.

Accomplishments that we're proud of

We are proud that we: Successfully integrated motion tracking into a real-time game. Built an interactive fitness experience that’s engaging and responsive.

What we learned

We learned: Fine-tuning pose detection for accurate movement recognition. The power of blending gaming and fitness to create a new way to exercise.

What's next for MetaPhysical

We would love to do: Multiplayer mode for real-time fitness challenges with friends. New movement mechanics. Adaptive difficulty/speed & fitness tracking to personalize workouts.

Built With

• javascript
• tensorflowjs
• three.js