We had heard about the rising popularity of Oculus Rift, and were wondering how we could wield it to build a cool hack. As two musicians, it became clear that VR-based Rockband was the way to go.
How it works
Python-based image processing see's what the drummer is doing. The Oculus Rift (based on the Unity Game Engine) let's the drummer see the drumset and surrounding environment.
Challenges I ran into
C#. 'nuff said.
Accomplishments that I'm proud of
We finally got Oculus Rift to work and used it to build a cool Virtual Environment.
What I learned
Image Processing, Unity Game Development, Oculus SDK Usage, and that hackathons are FRICKIN AWESOME.
What's next for Rockware
Using node based image processing to track the fingers of a guitar player!