Inspiration
We wanted to create an intuitive way for people to be able to make music with their computer wherever they go.
How it works
Oculus Rift with a Leap Motion controller mounted to the front detects head and hand movements to operate virtual instruments. Unity runs a game environment to render the piano/drums and generate sounds when the users hands collide with them.
Challenges I ran into
The Leap Motion sensor is prone to overheating, isn't as accurate as we would like, and is very sensitive to placement and orientation.
Accomplishments that I'm proud of
Being able to incorporate multiple instruments into the same demo.
What I learned
How to develop for the Oculus Rift and Leap Motion controller using Unity and C# scripts.
What's next for Leap Music
Adding the ability to record tracks and play them back to create full songs. Also adding more instruments, synthesizers, etc.
Log in or sign up for Devpost to join the conversation.