leapStudio

Inspiration

Chirag is an up and coming rapper and he wanted to make fresh beats for his upcoming mixtape, but found it very hard to utilize a digital keyboard online with just his mouse for interaction.

What it does

The application allows the user to use their hand gestures to play a digital piano and soundboard

How we built it

We coded in java utilizing the leap developer sdk for the motion tracking and we used Unity to set up the environment.

Challenges we ran into

He ran into trouble when we tried to create the clicking motion of the mouse and mapping that to the downward press of the index finger. Also we had issues when we had to make the jar file for the Leap Motion run in the background.

Accomplishments that we're proud of

We are proud of getting up and running with coding the leap motion with limited resources and creating a dynamic and aesthetic environment in Unity.

What we learned

We learned how to utilize unity for creating a digital environment and we learned how to code for the leap motion using java and mapping hand gestures to the mouse cursor.