We felt inspired to create a tool that would allow an artist to paint music in a real world space. To not only hear the music that they create but also to see it.
It utilizes the Hololenses spatial mapping, voice recognition, gesture control, and most importantly 3d spatial audio to create a multi textured environment of audio and colors. We are basing the audio beats and colors on natural wave forms and color theory to help simulate a visual approach to hearing music. Mix the with some kick ass animations and effects to tickle your visual and audible cortex
We built it primarily within Unity and Visual Studio, utilizing Blender for modelling, and Logic Pro X for midi control and pre processing of audio clips.
https://vimeo.com/195568334 -- quick pitch video
https://vimeo.com/195568207 -- raw footage captured during monday demonstrations.