Aurora Sound Stage

Inspiration

Many of us rely on music playlists that fits our mood or current activity. However, these playlists are not very dynamic in that they often only encompass a single genre.

What it does

Aurora is a Chromium extension that provides a wide variety of music genres/types that is adaptive to the content that the user is viewing

How we built it

We created a google extension that when activated, detects the mood of the current page through image recognition/classification, then, Aurora plays the music of the corresponding category.

Challenges we ran into

We successfully categorized the contents of the screen, but ran into issues where the music fail to adapt to our classification, another issue was determining the optimal interval/duration between changes in the music style

Accomplishments that we're proud of

We successfully classified the mood of the user's current viewing content, successfully designed a coherent and sensable ui that enabled user to make necessary controls.

What we learned

This project taught us a lot about real-time data processing and mood analysis. Working with Google Vision and the Gemini model gave us insights into machine learning and data categorization. We also learned how to enhance user experience through responsive design and how music can deepen the engagement with a story.

What's next for Aurora Sound Stage

We envision integrating data, like heart rate from a smart device, to match music styles to workout intensity dynamically. We plan to enable streaming of user-selected music by utilizing an API to access their music streaming service account. In the future we envision connecting streaming services to allow more variety in music choices. We could also expand our extension to include other user data such as heart rate from an smart watch to play music based on the workout intensity.