Just_Renegade

Inspiration

We loved seeing peoples' videos on Tik Tok, but we always wanted to learn how to do the dances. Thankfully, with this app, we can dance to Renegade.

What it does

Users press the start button and can start dancing along to the popular Renegade Tik Tok. Using computer vision, their accuracy will be scored.

How I built it

We developed a pseudo native app using Python and front-end web technologies. Users interact with a Selenium-controlled Chrome browser, which changes the text in an invisible paragraph tag to communicate with a Python script. This script controls the state of the game and even edits the DOM to display the video. We used the Open Pose library to detect poses, and using some clever math involving calculating angles between points of interest, we compared the user's video to the original video to score their accuracy.

Challenges I ran into

Architecting for multiple platforms while maintaining the Python layer for processing poses and the web layer for displaying the user interface. A lack of hardware powerful enough to handle graphical workloads greatly hindered our progress and performance.

Accomplishments that I'm proud of

Kavin is proud of hacking together a messaging layer using Selenium instead of Electron. Sarah is proud of Richard's dance move. Richard is proud of everything and everyone.