Emotio

Extension pop-up start
Extension statistics in a different tab
Extension pop-up working
Extension about/info section

Inspiration

In a world inundated with digital content, it's easy to fall into the trap of mindlessly consuming media. The idea of creating a mindful digital companion emerged, a concept that accompanies users while they consume online content, promoting positive and thoughtful engagement.

What it does

Emotio, a Chrome extension, transforms video browsing by using Hume's AI models and Streaming API. It introduces a friendly avatar, reflecting the top 3 emotions detected in the video. Graphical representations offer users a nuanced understanding of the video's emotional tone, fostering awareness about their content choices.

How we built it

Emotio was crafted with a blend of technologies: JavaScript, TypeScript, Looker Studio, Google Sheets API, Hume's AI models + Streaming API, MaterialUI, and React. This diverse stack enabled the creation of an interactive and visually engaging extension.

Challenges we ran into

Implementing real-time emotion analysis from video and audio streams;
Integrating multimodal analysis proved extremely challenging due to the necessity to isolate the modalities themselves being convoluted and complex in a live context. Moreover, because they needed to be streamed, the Google Chrome browser API was useful but extremely difficult to decipher.

Accomplishments that we're proud of

Successful integration of Hume AI's Streaming API for emotion analysis. Development of a cute digital companion that reacts to content, adding an emotional element to the consumption experience. Creation of data visualizations to offer users insights into their media consumption habits. What We Learned: The project provided insights into real-time emotion analysis, data visualization, and human-computer interaction. It highlighted the potential for technology to positively influence user behavior and foster mindful content consumption.

What we learned

Throughout the project, we deepened our understanding of AI integration, real-time data visualization, and user experience design. Overcoming technical challenges honed our problem-solving skills, enriching our development expertise.

What's next for Emotio

In the future, we plan to: Expand Emotio's compatibility with various streaming platforms. Incorporate more sophisticated machine learning models to better understand user emotions. Explore the possibility of offering personalized content recommendations based on emotional analysis. Emotio is not just a companion; it's a step towards making digital consumption more mindful and emotionally aware. 🌟