🧠 Inspiration

Sometimes when dining out—especially abroad or at unfamiliar restaurants—we're faced with a menu we can’t read or simply don’t know what’s good. It’s hard to tell what a restaurant’s signature dish is, what suits your taste, or what locals would recommend. That’s why we created AIMenuBuddy—an AI companion that reads the menu for you and picks out the best dishes in seconds.

🍽️ What it does

AIMenuBuddy lets users upload a photo of any restaurant menu and instantly get personalized dish recommendations.

You’ll receive:

  • 🌟 Top dish picks with flavor descriptions and reasons
  • 👥 Suggestions tailored to different diner types (foodie, health-conscious, comfort seeker)
  • 🍷 Pairing ideas and chef-like insights
  • 🌐 Available in 5 languages: English, Chinese, Japanese, Korean, and French

🛠️ How we built it

  • Frontend: React 18 + TypeScript + Tailwind CSS
  • Image Upload & Preview: Drag-and-drop + base64 conversion using FileReader API
  • AI Integration: Google Gemini api
  • Internationalization: Dynamic language switching with localized prompts and content
  • UI/UX: Modern card-based layout with glassmorphism, micro-interactions, and responsive design
  • Dev Tools: ESLint, Vite, strict TypeScript mode for maintainability

🧱 Challenges we ran into

  • Prompt engineering to extract helpful and relevant food suggestions
  • Handling poor image quality or complex menus with inconsistent layouts
  • Accurate translation and cultural localization in five languages
  • Balancing AI features with a clean, intuitive user interface

🏆 Accomplishments that we're proud of

  • Successfully integrated real-time AI menu understanding from just an image
  • Delivered a polished UI with interactive, mobile-friendly experience
  • Provided fun, insightful recommendations that feel human and personalized
  • Built a complete MVP under tight hackathon deadlines!

📚 What we learned

  • Prompt tuning is key for multimodal tasks using AI models like Gemini
  • UX consistency matters just as much as technical functionality
  • Good localization goes beyond translation—it’s about user context and cultural tone
  • Small UI details like feedback states greatly improve perceived usability

🚀 What's next for AIMenuBuddy

  • Add image-based dish recommendations alongside menu analysis
  • Introduce user preferences for tailored recommendations
  • Launch as a Chrome extension and mobile-friendly app
  • Support voice-based input and audio recommendations
  • Partner with restaurants for featured "house specials" powered by AI

Built With

Share this project:

Updates