We were thinking how fun it would be to DJ in the air
What it does
How we built it
Challenges we ran into
There were alot of challenges we ran into, one of the challenges was trying to determine whether your hands pass through a yellow dot to count as one point of our system, which we solved using reference point system and some basic math. Another issue was trying to slow down music without affecting pitch which JS doesn't easily do, and in fact is a non-trivial problem in audio processing. We did this be pre-rendering the files using aduacity and python scripting. Another challenge was correlating the velocity of the hand to the tempo of the music, this was particular challenging due to the limitation of the sensor and the new concepts in computer vision we had to learn. Finally, and most importantly, learn JS we picked up JS only a few days before the hacknroll and some of us picked up even at the hackathon itself.
Of course there are many more like the switching between the audio files and even the animation of the entire game, but you will see them when you come to our booth.
Accomplishments that we're proud of
Overcoming the challenges we faced and freaking learning JS.
What we learned
JS , HTML, CSS and alot of web tech.
What's next for Leap motion auditory overload (LMAO)
Probably create a feature to control the pitch of the music and maybe even add a composer mode where uses can control the weights of a generative neural net to make music instead of only controlling it.