Lift Lab

What it does

Traces body movements during a video, primarily geared towards lifting weights.

How I built it

By using Google's mediapipe library, I was able to plot pivotal joints across the body (wrists, elbows, ankles, etc) and record their movement during the video.

Challenges I ran into

The biggest hurdle was trying to create a react-native application that can take uploaded media and using AWS & boto3 for backend processing. By the deadline, I was unable to integrate a react-native app so I used Google's Colab jupyter notebook service to locally produce the demos.

Accomplishments that I'm proud of

In retrospect there were a ton of roadblocks/lack of preparation on my part, such as volunteering and rushing over to the competition with 5 minutes left to spare, as well as not having an idea to come into the competition with. On day one, I think I first started writing code around 5pm, and during the night I got hit with a wave of cold symptoms. So I'm glad I stuck through the end despite having so many hurdles

Future of Lift Lab

Integrating some sort of feedback for lift validity (given a federation) and tracking barbell velocity could offer some really useful insights for lacking points and ways to improve that specific point. Body tracking through objects/background distinction is quite weak.