Face one with FLIR ONE

Inspiration

In Neuroscience research, the studies of neurovascular according to human feelings are being continued. But the ways are limited because they use methods which have some problems. First, they use measurement tools physically contacts the skin. Second, non-contact methods such as MRI which irradiates in a strong radiation to a subject. Also subjects should not move. The thermal imaging technology is a solution to overcome these problems. That is FLIR ONE. FLIR ONE is safe because it does not emit anything. And it can take the natural movement of the subject. So, if we use FLIR ONE, we can see the human feelings. Then, how could we know human feelings!? We need funny and cool idea!!

What it does

"FACE ONE with FLIR ONE" can show the emotion of the subject by the character, Fofo which named by the first alphabets of the app name. If a face is detected, "FACE!!" message is shown in the left corner of the screen. Then the user can take a picture and the emotion is analyzed by the face temperature, the movement of mouth and eyes. According to the emotional state, this app shows Fofo which have facial expressions - big smile, so-so, depressed. The picture is saved with Fofo and can be shared by SNS.

How we built it

We used Android Studio, Java, Android and FLIR ONE (for android).

Challenges we ran into

Choosing the subject was the most difficult point of this project. We discussed over and over which app can be used easy and entertains users. As a result, "FACE ONE with FLIR ONE" was selected. During the development, we ran into the challenge to define the algorithm that this app to detect a face and analyze the emotion by thermal image. Also synchronizing the detected face and the FLIR’s thermal image to prevent each frame was little hard. However we did it and FACE ONE is the result of these.

Accomplishments that we're proud of

1. Idea Accomplishments ⒜ We used cool idea to see the human feelings and we’re very proud that this app can detect the human feelings precisely. And also, you can see each other’s feelings fast, conveniently and funny. This is really cool!! ⒝ By using our character Fofo and funny sounds, we can give entertainments to user. 2. Technical Accomplishments ⒜ The advantage of this app is that you can see the emotions anytime and anywhere. And you can share it by SNS. Isn’t it funny? ⒝ On the technical side there were great accomplishments. First, we made it possible to take a picture by using the app and separate thermal image with original image. After that, we could get the temperature information from the thermal image and get the movements information of mouth and eyes from original image. Finally, we combined the two information and determine the human feelings. We’re really proud of this technique.

What we learned

We learned that the FLIR ONE has infinite of possibilities and the thermal images are everywhere!

What's next for Face one with FLIR ONE

Now this app has only 3 emotional Fofo but the range of emotion would be widened and this would be improved to the body temperature to analyze the emotion more accurate. Also, it would be used at videophone to real-time emotion analyze. In addition, we have a plan to develop iOS version.