NeuroActiveSys

Inspiration

We vision a game system that go beyond mere an interactive gaming system. We want to build a neuroactive sensitive gaming system that can catch the gaming experience of the users at realtime. Also, we would like to use different sensors, controllers and display to make the game more immersive.

What it does

The NeuroActiveSys immersive gaming system creates an unparalleled gaming experience, where users' emotions and level of excitements are captured and gathered. Based on the neural activity's information collected from Muse headset, and data analysis facilitated by Nueromore, NeuroActiveSys automatically change the difficulty to adapt users actual emotional status when they are playing the game.

How I built it

We used Oculus Rift, Myo to enhance the gaming experience. We used Muse to capture the concentration and relaxation status and used neuromore software to analyze the data. And we uilitized Unity3D as our game engine. For back-end, we set up a Java server to communicate with the game.

Challenges I ran into

Muse blue tooth connection is not stable.
First time using Unity3D
Integrating different hardwares and software system is hard
Processing neural activities data is no easy task

Accomplishments that I'm proud of

Complete the whole system
Get feedback from neural status of the users, such as concentration level and relaxation level.

What I learned

Unity3D
SDKs for hardwares
Neuromore and OSC

What's next for NeuroActiceSys

Use mind to control the game

Built With

Submitted to

PennApps XII

Created by

I worked mainly on the Unity3D and the Oculus Rift connection. I tested the game operations and evaluated the Unity3D components in order to control and optimize the game actions and the Oculus.

Gabriela Amaral
I worked as the designer of the team. I'm mainly responsible for 3D modeling and scripting basic operations of the game.

Jerome Zhong
I Proposed the idea. In the project I was mainly in charge of the Muse hardware setup and connection, data gathering, Neuromore data analysis, and Java back-end to provide realtime neural status data.

Yiren Lu
Participated in coming up the idea and evaluating ideas. I did logistic dev with the game engine in C#, and did experiments on different analysis tools. I've also done the client side with our analysis data server running on our game engine.

George Sun