Resonant

Inspiration

DJing is more than mixing tracks — it’s the art of storytelling through sound, guiding a crowd on an emotional journey. But even the most experienced DJs face the challenge of balancing technical performance, managing equipment and reading the energy of the crowd. We wanted to create something that would help DJs feel more connected to their audience without distracting them from playing music. That idea became Resonance: a HUD built on Snap Spectacles that gives DJs real-time feedback on the vibe they’re creating.

What it does

Resonance is an AI-powered heads-up display designed for DJs. It calculates a hype score from the crowd’s movement and sound levels in real time, utilizing live video input. It displays the currently playing track overlaid onto the decks, so DJs can stay oriented without looking down at their gear. It shows a hype graph across the session, visualizing how the crowd’s energy has shifted over time.

By layering this directly into the DJ’s field of view, Resonance gives artists subtle but powerful feedback, and was DJ approved (shoutout to our friend)!

How we built it

We combined computer vision and audio analysis to calculate the hype score. Movement intensity and sound dynamics are translated into a normalized value, updated live. We then built a lightweight Spectacles Lens overlay that anchors three key elements — hype score, hype graph, and current song — spatially in the HUD. We also built a custom API that hacked together RekorderBox and Snap Spectacles, two applications that were never meant to be together.

The technical stack included:

Computer vision for crowd motion analysis.

Audio analysis for volume and rhythm dynamics.

Custom HUD design for Spectacles, carefully arranged to provide information without cluttering the DJ’s visual space.

Challenges we ran into

One of our biggest challenges was striking the balance between useful information and sensory overload. DJs are already multitasking with sound, gear, and lights, so we had to design a HUD that was present but not distracting. We also ran into technical limits with processing speed and had to simplify our AI models so the hype score could update in real time. Finally, since we cared deeply about privacy, we had to design our system to process data in the moment without recording identities.

Accomplishments that we're proud of

We’re proud that we created a system that feels artist-first. Instead of automating away decisions, Resonance enhances intuition and amplifies creativity. We’re also proud of our HUD design — it feels seamless, natural, and respectful of both the DJ’s workflow and the audience’s experience. And we’re especially proud that we were able to bring this vision to life in just 24 hours.

What we learned

We discovered just how challenging it is to build AI tools that integrate smoothly with new technologies. In the beginning, we had to run across campus and call multiple people to find a way to procure a DJ controller and speaker set. When we finally got setup, dodging cable issues and limited documentation, we had to quickly get up to speed on Lens Studio while also figuring out how to make API calls to Gemini work reliably. This, coupled with trying to pass data from another laptop, through the DJ controller, to the glasses posed a great challenge. These hurdles forced us to think creatively and test unconventional approaches. In the end, what initially felt counterintuitive turned into practical solutions.

What's next for Resonance

Looking ahead, we’d love to expand Resonance with features like:

Showing lyrics for the crowd, synchronized with the DJ. Reactive visual overlays for lights and visuals using tools like TouchDesigner. (we really tried to get it working with the BBB stairs lights!) Multi-Spectacles connections, so fans or collaborators could share synchronized experiences like karaoking with friends. Smarter song insights, like automatic setlist annotations that show the crowd’s reaction to each song. A small, playful creature to dance next to the DJ board, adding charm while visually reflecting the crowd’s mood. Our vision is to turn Resonance into a full ecosystem where artists and audiences share a richer, more connected experience– powered by AI so music lovers can stay immersed in the moment instead of getting distracted.