Inspiration

I've been playing around with interactive music for the past few years. Music makes you feel things that you can't quite touch. I created Music Toy as a way to add touch and play to music. The music came from my TouchDesigner based interactive installation piece, Resonant Sparks, which was composed by Eimear MacCarrick. Each stem of the music has its own personality and I realized that with Specs I could make each one its own squishy little jewel-toned toy that expresses that personality in a playful way.

What it does

Tap or pinch each toy to turn it on and cycle through its 3 volume settings. As you hover near them, the toys lean towards your hand and glow slightly to let them know you can interact with them. Pick them up and watch them drift back down. Move the whole stage or each toy individually to find the right placement. A reset button will call them all back to their original locations. As the toys move to the music, ripples form and interact with other ripples. Tap your fingers to the rhythm to make ripples of your own.

How we built it

I built it in Lens Studio using CLAD, the Devpost Learn Skill Pack, and Claude Code.

Challenges we ran into

Not having the device meant that I had to test all interactions with the mouse. Lens Studio's additive visuals meant that opacity had to be decided through brightness, visually setting it up so that brightness drove opacity was a new way of working and presented some challenges. However, I think in the end that drove the look in a fun direction.

Another challenge was UI. I wanted to make it as intuitive as possible without needing any tutorials or text because that pulls people out of the experience and makes it all about figuring out what to do rather than actually experiencing the toys and music. Also, any text means that language is fixed in English and reduces accessibility. In the end I realized I needed a Reset button, but hopefully I can change that to an icon down the line.

Accomplishments that we're proud of

I love the way the toys turned out and hope to work more with them down the line. I also love the the ripples interact between the toys and finger taps.

What we learned

It was my first Specs project so everything I did was something I learned ;-)

What's next for Music Toy

I'd like to test it out in a device if possible. I'd also like to make the toys bounce home rather than scoot. I'm considering adding googly eyes to them as well. I like the idea that simple eyes could blink and bounce a bit with the music to turn the toys into characters.

Built With

  • clad
  • claudecode
  • lensstudio
Share this project:

Updates

Submission history