Duang Faces

• 

  After Emotion Recognition and adding special effects. - Happiness

• 

  Before - Happiness

• 

  After - Surprise

• 

  Before - Surprise

• 

  After - Disgust

• 

  Before - Disgust

• 

  After - Sadness

• 

  Before - Sadness

Inspiration

First, when we use the WeChat to communicate with our friends, if we input some special messages such as "Happy birthday", the software will give back us special feedback information like the fallen birthday cakes too. Second, we can use some emoticons to express our emotions at the time, and it's also a good way to talk with others on the Internet. So we think that what if we use these two ideas on video chatting. We imagine that when we are video chatting with somebody, there will be no changes if we behave normally; but if we have some emotional changes, there will be some special effects appearing on the screen to show your emotion or strengthen the expression of your emotion. Video chat will be more interesting and active in this way. And our first inspiration comes out. We want to develop a project that can show the real-time special effects on the screen based on the Emotion Recognition, which is a part of the Face Recognition technology. But because of our limitation of knowledge and time, we just develop the special effects adding to a static picture.

What it does

It recognizes the emotion of a person on the picture and add some special effects on the picture to strengthen the emotion expression of this person.

How we built it

We used the Emotion API and the Vision API of Microsoft to recognize the emotions of persons, and we used a Python library called PIL to manage to read pictures, add the special effects, and some other functions.

Challenges we ran into

The biggest challenge we ran into is that we didn't know how to implement the real-time replacing of every frame of the video and upload to whom you're talking with, and we still can't take over this challenge......Then, we need to study a totally new library of Python to work on the pictures, and we need to adjust the API with our own program.

Accomplishments that we're proud of

Now we can use API to get the information of emotion of persons and add the right and cool special effects~

What we learned

We learned that how to use some third parties' APIs and how to do with image processing in Python.

What's next for Duang Faces

We will realize our initial idea. That is to say, we will extend our project from the image processing to real-time video processing, and use it on the video chat.

Built With

• microsoft-emotion-api
• microsoft-vision-api
• python