Emotions 2 Beer converter

• 

  happy face

• 

  sad face

• GIF

  point anywhere

• GIF

  face and think

Inspiration

Depending on the emotions of people, they should drink beer or better should drink beer. That's why we came up with the idea of recognizing emoitions of people, let the matrix creator light up accordingly and let it have a conversation with the person which in the end leads to leading the person to the nearest bear.

What it does

• Light up the LEDs from the Matrix Creator in not just different colors, also in different modes. Everything controllable via ROS calls.
• recognize the emotion of a person through deeply

How we built it

• We were using, the Matrix Creator and former developed ROS Subscribers from one of the Roboy repositories(https://github.com/Roboy/roboy_matrix_utils). We added some more subscribers and LED modes to it.
• We used SAM from the Talk to Two Roboy project (https://github.com/Roboy/ss18_talk_to_two) to record and transform speech to text
• We used deeply (http://www.deeplyapp.de/) to get peoples emotions from camera input

Challenges we ran into

• compiling deeply on a raspberry pi was a challenging task
• stucking everything in 30 mins before the presentation is a hard thing to do

Accomplishments that we're proud of

• The new LED modes
• that the LED colour and mode is changing according to specific keywords ( green for happy, red for sad)
• that in the end we could get deeply to work on the raspberry pi

What we learned

• How to abstract the LED mode code, such that colour and shape are controllable without beeing influnced by other calls
• how to compile deeply ## What's next for Emotions 2 Beer converter
• Use the things and the knowledge we developed thorughout the weekend further for even more interesting Roboy Projects

Built With

• computer-vision
• cpp
• deeply
• matrix-creator
• python
• ros