Audio inspiration - Sound Art, Brian Eno, John Cage, Cluster, Aphex Twin, Generative Music, Interactive Music, Soundscape Visual inspiration - Kandinsky, Dali,
What it does
triggers and builds a soundscape through the user interacting with sound objects.
How we built it
It was built in Lens Studio. Music elements were composed in Logic X, and visual elements were made in Adobe Illustrator, Rhino, and Keyshot.
Challenges we ran into
Getting the gesture to work properly, we were both new to Lens Studio, but it's a space we want to explore in especially as it relates to sound, visualized sound, and machine learning.
Accomplishments that we're proud of
We are proud we finally were able to figure out how to get the gesture to be able to grab a number of different objects as we were working through a variety of bugs of it grabbing more than one. Even the snap mentor couldn't help us when we asked. It's still a very rough draft of what we want to build, but it's a working version of the core of our idea.
What we learned
We learned a lot, including about different working styles. We both were very new to Lens Studio, so we had to get use to how it worked and what its capabilities are. We have creative coding backgrounds, but both come from a more digital media fine arts background as opposed to a developer's background.
What's next for AR Sonic Painter for Snap
We want to refine the gesture code to work better. We want to develop code to manipulate or alter the audio in different ways based on how they are placed within the 3D space. We want to develop our visual elements and add other visual feedback. We plan to develop it until it is what we want.