GlutenGoblin

Snap a photo of your food, and let an unhinged goblin tell you if it's safe. Because checking labels is boring. Meltdowns aren't.

Comment

Inspiration

Team member Makayla was recently diagnosed with celiac disease, which means something as innocent as grabbing a snack can suddenly turn into a full detective mission. A quick trip for chips becomes: inspect ingredients, decode mystery words, squint at microscopic labels, and question every life choice.

For people with celiac disease, eating gluten can trigger an autoimmune reaction that damages the small intestine and can cause pain, bloating, fatigue, nutrient deficiencies, and long-term complications. For people with wheat allergies or gluten sensitivities, the wrong snack can also cause serious reactions.

We realized way too many people are being forced to become unpaid label investigators just to eat safely. So we created Gluten Goblin — a chaotic little guardian that helps users scan products and make safer food choices without needing a magnifying glass and a chemistry degree.

What it does

Gluten Goblin helps users quickly determine whether a packaged food product may be safe for someone avoiding gluten.

Users take a photo of the front and back of the package, and the app uses AI-powered image recognition to read labels, ingredients, allergen warnings, and gluten-free certifications.

The Goblin then delivers one of four judgments:

  • 🟢 Safe to Enjoy – no obvious gluten risks detected
  • 🟡 Use Caution – unclear information, possible risks, or no verified certification
  • 🔴 Avoid– ingredients or warnings that indicate gluten may be present
  • ⚪ Needs Review– not enough clear information to make a confident decision

To keep things fun, the Goblin reacts with custom animations, sounds, and dramatic snack-related opinions.

How we built it

Blood, sweat, tears, and highly questionable goblin labor.

First, we captured a goblin from a magical realm, trapped him in a computer, taught him how to speak, and gave him strong opinions about wheat.

Then on a more professional note, we built Gluten Goblin as a web app using Python and Flask, with HTML, CSS, and JavaScript powering the frontend.

We used Google Cloud Vision API to scan uploaded front and back package photos, extract text from labels, and detect ingredients, warnings, and gluten-free claims.

We created custom backend logic to classify products into Safe, Caution, Avoid, or Needs Review.

We also used ElevenLabs to generate the Goblin’s voice lines and audio reactions, because if an app is going to judge your snacks, it should do so with personality.

Finally, we polished the UI with animations, loading states, responsive design, and enough goblin energy to concern HR.

Challenges we ran into

  • We wanted to use Figma heavily for our UI, but connecting design to development was more difficult than expected.
  • Real food packaging is chaotic: curved bags, glare, tiny text, blurry photos, and fonts apparently designed by villains.

  • Trying to make a goblin helpful instead of terrifying was a delicate balance.

    Accomplishments that we're proud of

  • This being our first hackathon and building a fully working product from idea to demo.

  • Creating a fun experience around a serious health issue.

  • Successfully integrating AI image recognition into a practical tool.

  • Our Goblin mascot, animations, and voice lines.

  • Turning snack anxiety into something faster, easier, and funnier.

What we learned

  • Building in a team is rewarding, but communication and decision-making matter a lot.
  • Good ideas are easy — good execution is harder.
  • APIs are powerful, but real-world data can be messy.
  • We learned how to use Google Cloud Vision API, Google Cloud Console, ElevenLabs, Flask, and Vultr.
  • We learned that even serious accessibility tools can have personality and delight.

What's next for GlutenGoblin

The Goblin hungers for more features.

Next steps include:

  • Scan history and saved favorite products
  • More polished UI/UX
  • Personalized settings for celiac disease vs wheat allergy vs sensitivity
  • Better certification logo detection
  • Live camera scanning
  • Seasonal monster skins (Pumpkin Goblin, Holiday Goblin, Beach Goblin)
  • Multi-language support
  • Mobile app launch

Our long-term goal is to make Gluten Goblin the most trusted tiny monster in grocery stores everywhere.

Built With

Share this project:

Updates