New user :)
Drum and Amp
User Interface with notes

Motivation

Kevin started playing the guitar 2 months ago and loved playing along with music, but found it cumbersome to load drum tracks for every song. We wanted it the other way around: a band that listens and follows you. This project accomplishes this in two ways:

It listens. Our Boss Katana amp doubles as a USB audio interface, so the laptop hears exactly what you're playing in real time. Signal processing finds every strum to track your tempo and where the beat falls, and Spotify's Basic Pitch neural network transcribes the notes to work out which chords you're playing.
It plays back. A push-pull solenoid strikes a real drum, fired a few milliseconds early so every hit lands right on your beat, while a synthesized bass line follows your chords through the amp's speaker. Speed up, and the band speeds up with you.

We used computer vision to provide an accessible interface to interact with your instruments. No more hunting for drum tracks: just pick up your guitar, start playing, and the band falls in behind you.

How We Built It

Used an electric guitar, an amp, a drum, a solenoid to play the drums, and a relay module. The total cost of materials excluding guitar and amp was $45! To mount and elevate the solenoid onto the drum, we 3D printed a bridge mount.

For the User Interface, we added colors red for the bass and blue for drums and showing the notes currently played.