I am a computer science major, and my friend, Will, who has never programmed but is majoring in Chemical Engineering and Music, wanted to come to crimson hacks. We decided to make a piano using index cards and a Leap Motion as it combined both our skills.
What it does
Place an index card on the table, and select what note it represents in the interface. We use the Leap Motion to detect when you press the card and then the computer plays the appropriate note. There are also options to make cards change the volume or instrument.
How we built it
Challenges we ran into
The Leap Motion can have a fair amount of noise sometimes, so getting accurate data was difficult. We solved this by taking multiple data points (finger locations, hand location, etc.) and using these to help smooth the data and best guess the position of the user's index finger, which they must use to play the notes.
Accomplishments that we're proud of
Dealing with the initial problems with noise filled data and data accuracy is something we're proud of. We were worried the project would not be possible and finding a way work around this was encouraging.
What we learned
What's next for SoundAir
We would like to include more options, multi-user support, chords, more sounds, a drum kit, and the option to use objects other than index cards if we had more time to continue this project.