Smiling Platformer

• 

  The mascot

• 

  The game demo

Inspiration

Smiling is a habit building process, and it takes over time to get a comfortable smile. The user would like an application that keeps track of their smiling progress through a game.

What it does

The user smiles in front of the camera to control the dog character, Mochi, to jump over obstacles. If they touch the obstacle, they lose the game.

How we built it

I mainly used MediaPipe Face Landmark Detection in Web to detect the user's smile and specifically the leftSmileMouth and rightSmileMouth. I used React, TypeScript, and HTML/CSS to create the platform game.

Challenges we ran into

There has been issues with the latency of the user's smile as there is a delay with the dog's jump start time.

Accomplishments that we're proud of

I was proud with the smile detection and how it encompasses the range of smiles.

What we learned

TypeScript and React was relatively new to me, so I learned about its syntax.

What's next for Smiling Platformer

I am planning to add a score counter to keep track of how many smiles the user makes to the game habit tracking. I'm also planning to deploy this game as a mobile app with the daily progress of how many smiles the user makes each day.

Built With

• html
• javasript
• mediapipe
• typescript