Inspiration
Inspired by the famous rhythm games Guitar Hero and Dance Dance Revolution, Emote Hero is a facial emotional recognition rhythm game that lets the player express four different emotions to the beat! Using Hume.ai and its ability to extract human emotion from facial expressions in real time, Emote Hero combines AI technology with rhythm game foundations to create a unique gaming experience.
What it does
Emote Hero accesses your webcam to scan your face and uses Hume.ai to detect the most dominant of four emotions: joy, sadness, surprise, and confusion. The player must express the correct emotion to move the cursor to the correct spot to match the emotion to the beat, similar to Dance Dance Revolution.
How we built it
We utilized C# and Unity to create our game combined with Hume.ai's API calls.
Challenges we ran into
Working simultaneously on Unity was not possible, and we were running into a lot of version-control errors due to differences in Unity packages/settings. Additionally, we had to find a way to turn Hume.ai's Python API calls into C#.
Accomplishments that we're proud of
We were able to make several calls to Hume.ai in real-time with the webcam showing on the game itself, and adding game mechanics and visuals made the application feel like a cohesive game.
What we learned
We learned a lot about working with Unity, as it was some of our group members' first time working on the application as well as C#. We also learned how to collaborate easily on different devices simultaneously.
What's next for EmoteHero
We would like to create a whole franchise in the facial emotional rhythm game market, adding new levels and quirks to our game as well as level customization for users.
Log in or sign up for Devpost to join the conversation.