Jungle Gym — Turning Rehab into Real-Time Motion Gaming

🚀 Inspiration

We were inspired by a simple but powerful truth:

Physical therapy is essential — but it's boring.

We’ve all seen it. Patients — kids, seniors, even athletes — get prescribed daily exercises they know they need... but just can’t stay motivated to do. It’s repetitive. It’s slow. It feels like it’s going nowhere. Add in the cost of therapists or VR gear, and most people quit before recovery even begins.

So we asked:

What if recovery felt like a game?
What if your webcam could be your coach, and rehab was something you wanted to do?

That’s when Jungle Gym was born — a motion-controlled rehab platform powered by computer vision and playful design.


💡 What We Built

Jungle Gym is a real-time, camera-based rehab platform that turns basic physical therapy exercises into interactive mini-games — no sensors, no wearables, just your body and a webcam.

We built six themed games across three key motion zones:

  • 🖐 Hands & FingersHatch Dash, Easter Race
  • 💪 Wrists & ArmsBanana Curl, Mountain Climb
  • 🦶 Feet & AnklesSoccer Save, Ladder Dash

Each movement you make — a fist clench, a curl, a jump — is tracked using MediaPipe + OpenCV, and directly drives gameplay. The more accurate your form, the better your score.

Whether you're doing basic hand mobility drills or progressing toward high-energy footwork, Jungle Gym makes it feel like you're in a game — not a clinic.


📚 What We Learned

We learned how to:

  • Use MediaPipe to detect and track joint positions with precision
  • Map physical therapy logic into fun, meaningful game actions
  • Create a scoring system that rewards form, effort, and consistency
  • Design for all ages and abilities — from fine motor rehab to post-op recovery
  • Optimize performance so it runs on any basic laptop with a webcam

🧩 Challenges We Faced

  • 🎯 Getting joint angle detection accurate and consistent — especially during fast or shaky movements
  • ⚖️ Balancing fun with function — the games had to be exciting and medically purposeful
  • 🧠 Making feedback useful — if someone’s movement was wrong, how do we show that clearly?
  • 💻 Ensuring low-latency performance on machines without GPUs

✅ In Summary

Jungle Gym turns your recovery routine into a series of motion-controlled challenges — powered by your body, tracked in real time, and designed to make healing fun, motivating, and measurable.

From your first fist squeeze to your highest step, you’re not just exercising...
you’re playing your way back to strength.

Built With

Share this project:

Updates