Poser!

What is Poser?

Poser! is a web application that gamifies at-home physiotherapy. Using a desktop or mobile webcam, Poser! tracks your movements as you exercise, generating performance scores and guiding you through an engaging and personalized exercise experience. With state-of-the-art pose detection and optical tracking, the app relays real-time feedback on how well the exercises were performed, helping ensure a smooth rehabilitation process

What it does

Poser! is a web app created using Django, with Javascript used for the camera and video element. The video is then fed into the PoseNet ML model. A JSON file with the positions of different body parts over time is obtained from this model. A reference video shown in the app is also shown, and a JSON is similarly obtained by running that through the PoseNet model. A score is then obtained comparing the positions of the body parts over time between the JSONs.