Inspiration
Inspired by the power of augmented reality to unite people and share experiences, SongSight transforms your space into a personalized musical gallery. Utilizing Snap Spectacles and integrating with Spotify, this project creates an interactive environment where virtual vinyl records represent your favorite songs. These records do more than play music—they act as portals to personal memories and moments tied to each track. SongSight also enables you to share these musical experiences with others, fostering connections as friends and family explore and relive shared memories and discover new songs together. This ambitious project seamlessly blends AR technology with personalized music exploration, offering a unique and engaging way to connect with music and those around you.
What it does
Project Description:
SongSight is an immersive augmented reality experience that transforms your space into a personalized musical gallery. Utilizing Snap Spectacles and integrating with Spotify, this project creates an interactive environment where virtual vinyl records represent your favorite songs. These records serve not only as a means to play music but also as portals to personal memories and moments connected to each track. Additionally, SongSight allows you to share these musical experiences with others, bringing people together to explore and relive shared memories and discover new songs together. This ambitious project seamlessly blends AR technology with personalized music exploration, offering a unique and engaging way to connect with music and friends.
How we built it
We developed SongSight using Lens Studio for the AR environment, integrating the Spotify API to fetch user-specific song data. We implemented gesture recognition to allow users to interact with the virtual records using Snap Spectacles.
Challenges we ran into
One of the major challenges was ensuring smooth and responsive gesture recognition under varying lighting conditions. Additionally, syncing the music data in real-time with user interactions posed technical hurdles.
Accomplishments that we're proud of
We are proud of creating a seamless integration between Spotify’s vast music library and Snap Spectacles' innovative AR capabilities. Our system not only enhances music engagement but also introduces a novel way to experience and interact with music.
What we learned
Throughout this project, we learned a great deal about AR development, particularly in optimizing performance for real-time music data handling and user interaction. We also gained insights into effective API integration and user interface design in an AR context.
What's next for SongSight
Looking ahead, we plan to expand SongSight by adding features like live concert streaming and social sharing capabilities. We also aim to refine our gesture detection technology to include more complex interactions, enhancing user engagement and expanding the application's functionality.
Built With
- flask
- javascript
- lensstudio
- openai
- typescript
Log in or sign up for Devpost to join the conversation.