RhythmiBrush

Hand drawing image, major points mapped to the hand
Major points mapped to hand, but fingers are opened

Inspiration

Computer graphics have always been very interesting to us, and we decided it would be cool to integrate it with an interactive application.

What it does

RhythmiBrush is a dynamic painting tool. As you play music, it adjusts your brush's color and size in real-time. The melody influences the hue, and the song's energy dictates the brush's thickness. Use your pointer finger to draw, and raise both your pointer and middle finger to erase (and adjust the eraser's size).

How we built it

We combined OpenCV for visual processing with the Spotify API (dubbed "Spotipy") to fetch song attributes. Python binds it all, translating audio features into visual parameters.

Challenges we ran into

Capturing real-time audio without lag was tricky. Integrating multiple libraries and ensuring smooth brush dynamics was a challenge.

Accomplishments that we're proud of

Creating a seamless blend of music and art. Watching a song literally "paint its mood" on canvas was rewarding.

What we learned

We learned various different Python libraries, including OpenCV, Soundcard, and HandTracker. Additionally, we learned how to incorporate the API from Spotify using the Spotipy library. We also learned and became more proficient with git.

What's next for RhythmiBrush

We're looking at adding more features, like brush textures influenced by song genre or mood-based backgrounds. The canvas is vast, and so is our playlist.