We were looking at the cool hardware available at HackTech and thought of ways to combine them to create novel solutions. One idea that stuck out was mixing Muse and Oculus to do neuro-feedback in a virtual reality environment.

What it does

ThinkVR tracks brain waves with Muse and passes it to Unity which creates a dynamic environment based on the data. In this environment, changes in the users mental state are reflected in a immersive virtual reality environment. Neuro-feedback is already backed by research showing that it's an effective treatment for mental health and this approaches it from a new angle. Also you can order food using the PostMates API.

How I built it

Muse API on backend to pass data to Unity, with various API added to provide additional functionality.

Challenges I ran into

We weren't familiar with Unity or C# so understanding a 3 dimensional layout based in a completely new software proved especially challenging. Hooking up and interpreting muse data in an Oculus app also proved quite challenging.

Accomplishments that I'm proud of

In Unity we were able to accurately ray-cast crosshairs to find where the user is looking. Another accomplishment was that Muse sends data through TCP but C# only has a UDP listener so we hacked Muse to send data in that format instead. Users can order food within the VR app.

What I learned

The basics of Unity, the world of Muse

What's next for Think VR

More moods and environments, custom hardware.

+ 1 more
Share this project: