MindSpace

Main menu
Inside of the counselling room
Pause menu/Settings
Outside of the counselling room
Night scenary
Scenary
Julien
Shooting star
Night time scenary
Scenary
Camille

Inspiration

Our inspiration is the current Mental Health state for most students at university/school - including ourselves. Sometimes, the homework and stress can pile up fast with no one to talk to about it. We decided to incorporate this issue into our project, in hopes to showcase something applicable to someone regardless of who you are as a person. Mental Health is just as important as Physical Health and is often under appreciated and valued. This is the reason why our game revolves around well - you!

What it does

This game features many utilities but mainly a personal AI agent powered by realistic audio and LLM support to deliver peak performance and listen to the user. In other words, it listens to the user and gives them a way to talk about their life. Additionally, through interacting with the world we hope to calm the user down and increase their calmness for the next task at hand.

How we built it

This project was originally visioned on Unity and involves working pieces from LLM models, creative libraries, and sub-track tools. The main AI therapist is powered by 11Eleven labs audio, deploying the best human sounding audio as well thinking.

Challenges we ran into

There were many inital challenges that we faced. One major challenge is linking Camera sensory to the actual AI Agent. *You see, having a AI Agent is cool and all, but what if there was a way to refine it dynamically and implement behind-the-scenes prompts without saying anything? This can imitate real-life conversations as people can understand someone off of their body-language, emotion, and way they present themselves. Using Presage, connecting the external .exe file in the x64 Visual Studio Native Tools(SDK) to Unity UDP at web socket specific port was a bit difficult to do, especially since there is no previous documentation on how to do it.

Accomplishments that we're proud of

We are two buddies who had their first hackathon at University with little to no experience. This entire project is a big accomplishment itself as we never thought we would make it this far.

What we learned

-Implementing 11Eleven Labs with Unity through its dedicated SDK kits -Connecting Presage SmartSpectra SDK to Unity via a Web Socket (port 9000) -Setting up a listener on Unity and C# editing -Claude Generation Models/Design and refinement for the actual game

What's next for MindSpace

Customization features such as growing a garden, enhanced weather (thunderstorm?), fishing, outdoor activies, and pets were all visioned for this game. In terms of actual mechanics, hooking up a expression reader, camera vitals, and setting up the AI would be the next step.