Playing an instrument is cool; playing an invisible instrument is even cooler.

What it does

You can play an instrument with the power of the Leap Motion: Use your hands to play an invisible piano. It also doubles as a soundboard. An octave of a piano is displayed onscreen, along with the current position of the user's fingertips. When a user moves their fingertip close enough to the sensor, it plays the note they hovered over. Press M to switch to Daft Punk mode!

How we built it

We experimented with the Leap Motion API to pull data from the sensor for individual fingertips. Our program was constructed in Java, with graphics rendered using the Java Swing framework. We render a two-dimensional piano on-screen, with circles that represent the current position of a user's fingertips.

Challenges we ran into

Integrating the Leap Motion API was a challenging experience. The tracking of the Leap Motion, while precise, cannot comprehend complex finger patterns that are required for playing a real piano. And the program crashes for unknown reasons when initally bringing a hand into view of the camera, but only sometimes.

Accomplishments that we're proud of

We developed a functioning piano, and a really cool Daft Punk soundboard! We're especially proud of the Daft Punk soundboard feature since waves ripple the user's fingertips and the keys glow neon colors when pressed.

What we learned

Leap Motion API, Java Swing framework

What's next for Music in Motion

Future iterations could include new instruments and more sound fonts for the soundboard.

Share this project: