Inspiration
Listening to music shouldn't be a passive activity. I want to be able to interact with it, to control it in real time. I want to feel as though I have a full orchestra standing in front of me every time I play a song -- and that's what Leap Conductor does.
Challenges
Getting meaningful data on the tempo from the leap motion. In order to avoid double triggers and missing beats, I had to find an algorithm that could reasonably determine when a hand's motion switched direction, and from that calculate the tempo.
Audio playback with realtime tempo adjustment is difficult. Currently, Leap Conductor uses note-by-note midi playback and integration with the FluidSynth audio backend to allow live tempo adjustment.
Accomplishments
Even with a lack of precision, the feeling of having control over the playback is exciting and exhilarating.
Log in or sign up for Devpost to join the conversation.