Inspiration
We saw many people who are around the world who need physiotherapy, but don't have access to it, and they really struggle with moving their joints mobility to build this so that there's a coach for them and act as a physical therapy coach for them for those were more disabled, and also our theme was crafting constellation, so we saw that of course his constellation in the sky, but it also constellations in our bodies.
What it does
Uses mediapipe model to detect joints, and from that it detects reps and whether you're and tells you how good your exercises are, and it recommends certain exercise exercises for physiotherapy and other pains.
How we built it
We used React, Python, and MediaPipe to track body movements. ElevenLabs provides voice instructions.
Challenges we ran into
Hidden joints were difficult to track, and head gestures sometimes triggered incorrectly. We adjusted detection and tested different camera positions.
Accomplishments that we're proud of
Users can point to a joint and control exercises with head movements. Their body becomes a moving constellation with live feedback.
What we learned
Camera position makes a big difference in tracking. Testing real movements helped us improve the controls.
What's next for Orion
We want feedback from physiotherapists and more reliable tracking. We also want to support routines chosen by a physiotherapist.
Log in or sign up for Devpost to join the conversation.