FaceBoi

Inspiration

We remembered games from our childhood, such as a Nintendo DS Kirby game in which the user was able to blow into the mic to make the player jump. Creating something with facial recognition seemed like a novel way to go beyond regular controls and implement something that people could have fun with. Another big inspiration was the VR game BeatSaber which inspired more of the aesthetics of the game and techno-vibes.

What it does

It is an infinite runner that is meant to challenge the user by making them make different facial expressions in order to get past different obstacles.

How I built it

The whole game was built using Unity Game Engine. We also used the Affectiva SDK to incorporate the facial recognition software to our game.

Challenges we ran into

We had some trouble implementing some of the facial expressions and emotions that would have to be made in order to be captured by the facial recognition software.

Accomplishments that I'm proud of

We managed to get the "happy" emotion recorded very well; the facial recognition software would easily know that we were smiling and react accordingly.

What we learned

We learned a lot of C# from scratch, many different Unity tools and how the Unity Asset store worked, and bettered our understandings of the different types of APIs and other dependencies available for use.

What's next for FaceBoi

We're going to be implementing more facial expressions that the facial tracking will recognize, add unique controls like using voice recognition(speech to text), and add more effects and animation to the game itself to make the game look better overall.