MovImotion

What if your mobile could adapt to your emotions? What if it could know if you are sad or happy and adapt your UI/UX?

Comment

Inspiration

Facebook, Google, Snapchat, they know everything about us. Where we go, where we live, who are our friends, even what we like or what we don't. But they don't know one of the most common questions: "How are you?".

What it does

Movimotion is an app that enhaces the User Experience by processing the facial expressions and emotions of the user through the camera. It can know when you are happy, contempt, sad or even surprised! It will adapt the colors and shape to give you the best app according to how you feel.

Movimotion can recommend you different kind of movies. Are you sad? It will ask you if you want to watch a happy movie or get some ice cream and watch sad movies. Are you happy? Continue being happy because Movimotion will recommend some of the happiest movies!

Movimotion also adapts the way you see the Ads in the app. It will show you ads of things that you may like when you are sad, if you are happy, well, it will show you whatever ad available.

Movimotion is not only one app of movies but is planned to be an SDK to incorporate in different apps. Companies like Smartly.io will be able to organize lists of different products in the best way possible, knowing the users reaction. Spotify may know what music you want to listen and Facebook can run better ad campaigns according to your expressions.

Think about all the data that is generated by facial expressions and how companies can take advantage of it.

How I built it

Movimotion is a native Android app using Java. It processes information in the background to connect to Microsoft Azure Cognitive services and recognize facial expressions. According to the facial expression, the app changes the resources to show to the user.

Challenges I ran into

Idea: Too aggresive? Maybe, that your phone is keeping track of your expressions all the time may seem rude. The same was said about Google knowing everywhere you go by using your mobile phone and now, everyone seems to dont care about it. The iPhone X already has a System only for face recognition, maybe this is where we are heading?

Technical: Since the app is not using an offline library but the API of Azure, it takes some time to update the UI/UX. For the future development, it is planned to incorporate our own Emotion recognition SDK.

What's next for Movimotion

It is planned to continue the development of Movimotion, changing the name since it will be only the SDK for mobile apps to help marketing companies based in users reaction.

Share this project:

Updates