PromptMenu

Logo Mockup
Menu Image Analysis result
Bot Loading
Bot in Action
Bot Answer
Sign Up last step
Sign Up first step
Login Page
Menu Image Analysis Page
Main Dashboard
Loading Page
Menu Image Analysis in Action
Menu Image Analysis loading
Menu Image Upload
Sign Up options
Home Page

Inspiration

PromptMenu is a digital menu platform that transforms the traditional restaurant experience by creating interactive, multimedia-rich digital menus. Inspired by the Four Seasons restaurant concept and BestEverFoodReviewShow, PromptMenu combines practical ordering functionality with engaging content like preparation videos, chef introductions, and customer reviews - all powered by Azure AI services.

What it does

PromptMenu is an AI-powered platform for restaurants that offers several key features:

Receipt and Invoice Processing: The system can automatically scan and analyze receipts and invoices, extracting key information like merchant names, items purchased, prices, and totals. This helps streamline accounting and inventory management. Menu Image Analysis: The platform can analyze food dish images to identify ingredients, provide nutritional information, detect allergens, and offer dietary advice. This helps customers make more informed food choices. Interactive Q&A Assistant: PromptMenu includes an AI chatbot that can answer customer questions about menu items, ingredients, dietary restrictions, and provide recommendations. This enhances the customer experience with instant information. Digital Menu Management: The platform allows restaurants to create digital menus that can be accessed via QR codes, making it easy to update prices, add specials, or modify availability in real-time. Multilingual Support: The system can translate menu information into multiple languages to better serve international guests.

How we built it

I built PromptMenu using a combination of modern development tools and cloud technologies:

Development Environment:

VS Code as your primary code editor GitHub Copilot to help with code suggestions and implementation Git for version control and code management

Frontend Development:

Next.js framework for building the React application TypeScript for type-safe code Material UI components for the user interface Tailwind CSS for styling and responsive design

Backend Services:

Azure Functions to create serverless API endpoints Azure Cognitive Services including Document Intelligence for receipt processing Azure AI Vision for menu image analysis Azure Language Service for the Q&A bot capabilities Azure OpenAI integration for advanced natural language processing Azure Container App

Database and Storage:

MongoDB/Cosmos DB for storing processed document data Azure Blob Storage for storing uploaded images and documents

Authentication and Security:

Microsoft Authentication integration Environment variable management for secure API key storage Token-based authentication with cookies Microsoft Entra Application Registration

AI Tools:

Azure Cognitive Services Azure Document Intelligence Azure Language Service Azure Blog Storage Azure OpenAI gpt 35 turbo model Azure Computer Vision

Development Tasks:

Created a modular, responsive dashboard interface Implemented file upload functionality for receipts and menu images Developed REST API communication between frontend and Azure Functions Built error handling and user feedback mechanisms Created mock data for development and testing purposes Refactored code for better maintainability and performance