I am a computer science major, and my friend, Will, who has never programmed but is majoring in Chemical Engineering and Music, wanted to come to crimson hacks. We decided to make a piano using index cards and a Leap Motion as it combined both our skills.

What it does

Place an index card on the table, and select what note it represents in the interface. We use the Leap Motion to detect when you press the card and then the computer plays the appropriate note. There are also options to make cards change the volume or instrument.

How we built it

We used JavaScript and the Leap Motion API

Challenges we ran into

The Leap Motion can have a fair amount of noise sometimes, so getting accurate data was difficult. We solved this by taking multiple data points (finger locations, hand location, etc.) and using these to help smooth the data and best guess the position of the user's index finger, which they must use to play the notes.

Accomplishments that we're proud of

Dealing with the initial problems with noise filled data and data accuracy is something we're proud of. We were worried the project would not be possible and finding a way work around this was encouraging.

What we learned

We learned how to use the Leap Motion JavaScript API and how to deal with error-prone data.

What's next for SoundAir

We would like to include more options, multi-user support, chords, more sounds, a drum kit, and the option to use objects other than index cards if we had more time to continue this project.

Share this project: