LeapPiano

Virtual Reality Environment Screenshot

Inspiration

As technological innovation is increasing at a rapid rate, a lot of industry and communities are having a hard time keeping up with the accelerated development of science and technology. The music education community currently has a hard time integrating new technology. The piano is one of the instruments that struggle to keep up with the fast paced technological movement due to its bulk and complex structure. Our technological solution to this issue is to make a virtual reality piano.

What it does

Using leap motion to simulate real world hands as a virtual reality copy that traces its movements. The virtual reality hands play a piano.

How I built it

Built it in unity created multiple objects to complete the task at hand.

Challenges I ran into

Connecting objects in the VR environment to the leap motion hands.

Accomplishments that I'm proud of

What I learned

That there are many implementations one could use for virtual reality.

What's next for LeapPiano

We will have a bot that teaches children how to play piano. A more visually aesthetic UI.

Built With

Submitted to

Hack Western 4

Created by

Created the physical keys on unity, and made the physical plane. Coded the back-end scripts in c# to detects collisions with the users hands, as well as the logical functions for audio.

Mohamad Elmasri
I worked on the backend development using c# so that when objects collided, there would be reactions including both a change of colour and an output of audio. Additionally, I worked on successfully implementing the use of a VR headset with a Leap Motion. I also contributed to building the piano keys and setting it up correctly, along with finding the samples and sound associated with each key.

Adam Ali
I worked on locating and implementing the sounds into Unity, this involved recording the sound clips to be used and writing the Audio script in C#. Additionally I designed the makeup of the keyboard for the piano which was applied to Unity. I also helped with planning our schedule and helping solve logic issues involved in the C# script.

Hasan Malik
I worked on the collision algorithm between the hand and the piano. I also made a realistic schedule for our team to follow throughout the hackathon. The plan that I made had deadlines which increased productivity and had pre determined break periods so that we don't run out of energy and work with steady momentum.

Liban Guled

Updates

Liban Guled posted an update — Nov 21, 2017 11:27 AM EST

LeapPiano made top 6 teams out of 110 entries in Hackwestern and got to demo our project in front of hundreds of people. We will continue to work on this project and it will be open sourced after some improvements.

Log in or sign up for Devpost to join the conversation.

Mohamad Elmasri started this project — Nov 19, 2017 08:50 AM EST

Leave feedback in the comments!

Log in or sign up for Devpost to join the conversation.