MRSense

Inspiration

Sensory rooms designed for those with Autism, ADHD, dementia, and other disorders, as well as anyone who wants some time in a comforting or stimulating space. A couple of us on the team have ADHD and autism, so this is an issue that's close to our hearts.

What it does

It allows the user to have a personal sensory room that is versatile: any time, anywhere.

How we built it

We utilized Meta's Presence platform tools such as Scene API, Relighting, Audio SDK, Multimodal Hand tracking, and Haptics SDK. We also used layers, Behavior Designer for critter behavior, lots of physics, assets from the Unity Asset Store for visuals, an original soundtrack composed during the hackathon, and some fun shader and texture tricks.

Challenges we ran into

We started with colocation but had errors with it. Some shader errors that appeared to be in the Meta packages caused intermittent build errors. And it took us quite a bit to get portals working; originally we tried using shaders, then moved onto URP layers. It would have been nice to have a building block for portals "out" of passthrough, as well as windows "into" passthrough.

Accomplishments that we're proud of

Getting the portals to work was an accomplishment for us, and we also managed to get music syncing after a challenging time where all the music tracks were slightly off from each other -- not a fun sensory experience at the time!

What we learned

We learned more and more about Meta's Presence Platform and how to utilize its plethora of tools and SDKs! We also did some research on sensory rooms, and we learned a lot from each other.