Inspiration
We wanted to use something involving computer vision, and chose Spotify as the API for it is free
What it does
Using the hand signs of rock paper scissors, it can pause, play, and skip a track respectively
How I built it
we used a pre-trained computer vision model from roboflow as the base, then used spotipy, which is a package that grants access to the Spotify API from Python to get access to the pause, play, and skip functions. From there, we used if/else blocks to execute the right action for each hand sign
Challenges I ran into
Getting Spotipy to work was definitely the biggest challenge, it was something that was such a heavy departure from everything else that we had worked on up to that point, and we had to do most of the heavy lifting, unlike the roboflow model which was trained for us
Accomplishments that I'm proud of
I'm very proud of how fast my group learned and evolved over the course of the one day we spent on this project. Going into this, none of us had any experience involving computer vision or APIs, so to have a result like this is something that we're extremely proud of
What I learned
I learned a lot about how to use computer vision models, as well as APIs, to solve problems.
What's next for Spotify Using Hand Signs
Our goal with this knowledge is to apply it into another project where instead of relying on a pre-trained computer vision model, we train our own model for a different purpose. We will also be working to iron out some of the minor flaws with this project, as well as expand this idea to other apps such as Youtube, Netflix, and Hulu, and creating a GUI to pick which app to use
Log in or sign up for Devpost to join the conversation.