Freaky Bird

Flappy Bird but it's Freaky :P

Comment

Inspiration

The recent trend of being “freaky,” symbolized by sticking out your tongue, has resonated with our group as a lighthearted and expressive gesture. Similar to the 6 7 movement, this playful behavior has spread across social media, and we wanted to turn that cultural moment into something interactive. That’s how Freaky Bird was born — a fun twist on a nostalgic classic that literally lets you game with your face.

What it does

Freaky Bird reimagines the classic mobile game Flappy Bird with an AI-powered twist. Instead of tapping the screen to flap, players use their tongue — yes, really! By sticking out your tongue in front of your webcam, the bird flaps and stays in the air. The goal remains the same: don’t hit the pipes, and try to fly as far as you can.

How we built it

Our first step was to rebuild Flappy Bird from scratch using Python and PyGame for game logic, graphics, and physics. Once we had a working prototype, we focused on integrating face-based controls.

Using Google’s MediaPipe and OpenCV, we processed the webcam feed in real-time to detect facial landmarks, specifically the mouth and tongue regions. MediaPipe’s pre-trained machine learning model allowed us to track when the tongue was extended, triggering the same action as a traditional “flap.”

Finally, we combined both systems so that MediaPipe’s AI detection could control the PyGame bird, creating a smooth, interactive experience where users can literally “play with their face.”

Challenges we ran into

  • 3/4 of us are new to Python, so we had to learn the syntax as well as libraries like PyGame.
  • We struggled at first to get the facial recognition to work consistently and accurately.

Accomplishments that we're proud of

  • Successfully integrating AI-powered facial gesture detection with a live PyGame environment.
  • Creating a fully functional game that can be played completely hands-free.
  • Designing a fun and inclusive experience that demonstrates how machine learning can make gaming more creative and accessible.
  • Turning a meme into a working, entertaining prototype in less than 24 hours!

What we learned

  • How to combine AI frameworks (MediaPipe) with traditional game engines (PyGame).
  • The importance of optimizing real-time video and model inference performance.
  • How small changes in camera input and lighting can drastically affect AI model output.
  • The value of teamwork and debugging when you’re tired, caffeinated, and trying to make a bird fly with your tongue at 3 a.m.

What's next for Freaky Bird

  • Possibly deploying as a WebApp.
  • Adding a currency system with unlockable skins.
Share this project:

Updates