GateBud
GateBud listening

✈️ About the Project

💡 Inspiration

During airline catering operations, we noticed how easily small human errors — a missing item, a wrong bottle, or a misplaced tray — could cause major inefficiencies.
We were inspired by gategroup’s mission to deliver consistent quality at scale and wondered:

What if employees could have a smart, voice-driven assistant that understands company policies and helps them in real time?

That idea became GateBud — a friendly AI coworker designed to make catering assembly faster, smarter, and more consistent across the world.

🤖 What it does

GateBud is a voice-activated AI assistant powered by Gemini, designed to help gategroup employees assemble airplane meal trays efficiently and accurately.
It listens to the worker’s voice, understands context, and provides live feedback about the tray’s contents and airline-specific policies — especially around alcohol handling.

Key capabilities:

Real-time voice guidance during tray preparation
Enforcement of airline alcohol regulations
Hands-free interaction to keep workers productive and safe

🧱 How we built it

Frontend: Built with React (TypeScript) and Vite for a fast and modular web interface.
Voice Processing: Integrated Web Speech API for real-time voice capture and transcription.
AI Backend: Connected to Google Gemini API, which processes text and reasoning to generate context-aware responses.
Implemented rule-based checks based on gategroup’s datasets (Alcohol Bottle Handling and Employee Efficiency).
Visualization: Used Recharts and TailwindCSS for live performance dashboards.
Testing: Simulated dataset scenarios to measure response time, accuracy, and interaction quality.

🧩 Challenges we ran into

Managing real-time audio processing and maintaining low latency (< 1.5s).
Designing a clear and intuitive UX for workers wearing gloves or multitasking.
Interpreting complex airline alcohol policies in a standard, scalable way.
Handling network restrictions when running Gemini models locally.

Each challenge helped us make GateBud more robust and human-centered.

🏆 Accomplishments that we're proud of

Developed a functional voice-enabled demo in under 36 hours.
Created a hands-free workflow that mirrors real-world catering conditions.
Built a solution that could be scaled globally within gategroup’s ecosystem.
Designed a minimalist UI that reflect the company’s professional image.

📚 What we learned

How to integrate multimodal AI models (Gemini) into a real-time web application.
The value of user experience design in high-pressure industrial environments.
How small data insights can lead to major operational improvements.
The importance of clear communication and cross-disciplinary collaboration under tight deadlines.

🚀 What's next for GateBud

Multilingual support for gategroup’s global workforce.
Integration with inventory and ERP systems for full operational traceability.
Implementation of voice-to-vision multimodality, allowing GateBud to verify trays through cameras.
Expanded scope beyond alcoholic beverages to include full meal assembly verification.
Deployment of pilot programs in real gategroup catering stations.

GateBud represents a step toward AI-assisted catering operations, where technology empowers workers to deliver consistent, high-quality service — every flight, every time.