Oscar Winning Composer A.R.Rahman performing at CES 2016 with Virtual Music Instruments.
What it does
Helps to create music anytime , anywhere virtually using Oculus Rift. Users can get an immersive experience in playing Virtual Music Instruments coupled with haptic feedback
How we built it
We used the Unity platform to create a virtual environment along with the instruments which can be visualized using the Oculus Rift. The instruments are interacted via a Leap Motion Sensor which recognizes the users hand gestures and imitates them accurately on the virtual platform. Contact surfaces were detected within the Unity platform between the virtual user and the virtual instruments. To make the experience more life like, we introduced Haptic Feedback via a wearable hand glove device, which vibrates upon contact with the instrument. MYO armband was incorporated for arm gesture detection which was then used in manipulating the environment(sound).
Challenges we ran into
-Synchronizing Unity and Arduino IDE. -Synchronizing hardware components. -Haptic Feedback.
Accomplishments that we're proud of
-Immersive 3D environment developed in Unity. -Impressive Haptic Feedback.
What we learned
-Realized the essence of VR and its scope on a larger scale, especially in the field of entertainment.
What's next for VR Musical Studio