-
Riley's Rhythms
Inspiration
Riley’s Rhythms was inspired by the idea that music can play an active role in emotional awareness and well-being. Drawing inspiration from Disney’s Inside Out, we wanted to create an experience that responds to how users feel in the moment rather than relying on past listening habits or popularity trends. The goal was to design a system that encourages reflection, comfort, and emotional understanding through sound.
What it does
Riley’s Rhythms listens to a user’s spoken thoughts, transcribes speech in real time, and analyzes emotional tone using Natural Language Processing. Based on the detected emotion and a user-selected music genre, the application provides mood-aligned music recommendations and adapts its visual theme to reflect the user’s emotional state.
How we built it
The application was built using Streamlit for the user interface. Real-time audio is captured using SoundDevice and transcribed offline with Vosk. Emotional tone is classified using a transformer-based NLP model from Hugging Face. Music recommendations are delivered through Spotify integration or YouTube search, while Base64 encoding is used to handle local visual assets.
Challenges we ran into
One of the main challenges was handling real-time audio input while maintaining accurate emotion detection and a responsive interface. Integrating multiple technologies and ensuring smooth interaction between them required extensive testing and debugging. Additionally, designing a dynamic user interface that adapts to different emotional states while maintaining consistent layout, readability, and visual balance posed a significant challenge.
Accomplishments that we're proud of
We successfully built a fully functional, emotion-aware system that works in real time and adapts both content and visuals based on user input. The offline speech recognition and dynamic UI transformation are key achievements of this project.
What we learned
We gained practical experience in integrating speech recognition, NLP, and interactive UI design into a single application. The project also strengthened our understanding of emotion-aware system design and real-time data processing.
What's next for Riley’s Rhythms
Future improvements include supporting more languages, refining emotion detection accuracy, adding playlist generation, and exploring applications in mental wellness and adaptive learning environments.
Log in or sign up for Devpost to join the conversation.