Sync Drive - Where Beats and Streets Meet

Sync Drive combines immersive audio visualization and artificial intelligence to create a musical artistic experience.

Comment

Inspiration

We wanted to create something in VR, be it a game or an experience. The Polygon AI+VR art experience track inspired us to make a music visualizer combined with a musical driving experience.

What it does

The application fetches music from the Lens Protocol, allowing you to play it in your car in VR (recommended to use Meta Quest 3, as we utilize hand tracking for a seamless experience). The main visual stimulus or fun experience is seeing the buildings move to the beats of the song, which feels magical. Additionally, you can mint music directly on Polygon without any sign or transaction fees. AI enabled voice assistance is available to play, pause, skip, and rewind songs. There are three feeds: Explore, which shows the most popular songs on Lens; Top Minted, which shows the most minted songs on Lens; and My Mints, where you can see all your minted songs once you log in. There's also a mini-game where you collect music beats from the road.

How we built it

We used Unity to develop this PC VR application ( it can also function on standalone ). We utilized the Meta Interaction Toolkit for hand interactions and tracking, and the Meta Voice SDK with Wit.ai for AI voice commands. Music is fetched from the Lens Protocol, and signless minting on Polygon is enabled with the help of a local wallet and profile manager from Lens.

Challenges we ran into

One of our teammates didn't have a Meta Quest 3, so we had to use the Meta XR simulator, which is challenging to work with due to poor controls. The hardest problem was syncing the movement of buildings with the song beats, which took 3-4 days to perfect.

Accomplishments that we're proud of

We created all the 3D assets for this project, and the environment turned out exactly as we imagined. The synchronization of music with the movement of buildings looks magical in VR.

What we learned

We learned how to connect wallet and perform on-chain transactions or sign messages in Unity. This ability will greatly aid us in integrating blockchain elements into our future games and experiences in Unity.

What's next for Sync Drive - Where Beats and Streets Meet

We plan to add multiplayer functionality where your friends can be present in your car virtually and more driving mechanics like drift with a new map (Curved roads). We aim to increase gamification with high scores and escalating difficulty levels.

Built With

Share this project:

Updates