Toys That Make Noise

Inspiration

We're inspired by what the new medium of Mixed Reality and what that can mean for content creation as well as the intersection between digital content and physical objects / environments.

What it does

Toys That Make Noise is a mixed reality audiovisual experience that sonifies objects in the real world and transforms them into reactive musical instruments and soundscapes.

How we built it

We used Vuforia with the Hololens and tried to get AR working with Mixed Reality. We brought in audiovisual content to activate experiences.

Challenges we ran into

It was tricky to set up our Unity project, since we're using Hololens and Vuforia, which each recommend running on different Unity versions. Furthermore, once we were set up with our project, there were kinks to works out to get the workflow going smoothly between the two programs. We also ran into a few issues with scanning 3D objects with Vuforia.

Accomplishments that we're proud of

We knew that using the Hololens with Vuforia might cause some issues, as the two haven't been widely used in conjunction, but we're proud of pushing beyond the technical challenges to create media that is truly innovative.

What we learned

Technically we learned how to use Mixed Reality with physical objects and integrate multiple Unity platforms and APIs. We learned how to create meaningful Mixed Reality experiences that infuse physical surfaces with digital content.