Inspiration

The inspiration behind SpiceVoice stemmed from a clear vision to revolutionize the traditional restaurant ordering experience, particularly within the vibrant and diverse Indian culinary landscape.
We aimed to bridge the gap between authentic dining and cutting-edge technology by creating a platform that is not only efficient but also deeply intuitive and personalized.

The core idea was to leverage the power of Artificial Intelligence and voice technology to streamline the entire ordering process for both customers and restaurant owners.


What it does

SpiceVoice is a comprehensive, AI-powered order management system for restaurants.

Key Functionalities

  • AI Voice Ordering
    Natural language commands; multilingual; conversational AI assistant.

  • Customer Authentication & Profile Management
    Secure login, profile autofill, phone number formatting, and guided onboarding.

  • Order Management
    Real-time status tracking (Pending, Preparing, Ready, Completed, Cancelled).

  • Menu Administration
    Add/update items, availability, price, tags, spice level.

  • Unified Delivery System
    Integration with DoorDash, Uber Eats, internal delivery, and simulated drone delivery.

  • Secure Payment Processing
    Stripe integration for one-time and subscription payments.

  • Premium Subscription
    Unlimited voice orders, exclusive items, 24/7 support.

  • Real-time Notifications
    SMS, email, and push notifications for customers.

  • Monitoring Dashboard
    KPIs, system health (CPU, memory, network), alerts.


How we built it

🖥 Frontend

  • React + TypeScript
  • Tailwind CSS for responsive design
  • Framer Motion for UI animations and transitions

🗄 Backend & Database

  • Supabase with PostgreSQL
  • RLS policies for secure data access

⚙️ Netlify Serverless Functions

  • create-payment-intent.js
  • webhook-stripe.js
  • verify-phone.js
  • send-sms.js, send-email.js, send-push.js
  • elevenlabs-convai.js, elevenlabs-tts.js
  • doordash.js, uber-eats.js, uber-eats-tracking.js
  • delivery-webhook.js

🎙 Voice Technologies

  • Speech-to-Text (STT): Browser Web Speech API, optional local Vosk server
  • Conversational AI: ElevenLabs + Convai API
  • Text-to-Speech (TTS): ElevenLabs with browser fallback

🔄 State Management

  • React Context API

🚀 Deployment

  • Netlify CI/CD from GitHub repo

Challenges we ran into

  • TypeScript Errors
    Compilation errors like TS6133 and TS18004 during Netlify builds.

  • Module System Conflicts
    Migrated all functions to ES module syntax (import/export).

  • API Integration Complexities
    Variances in endpoints/auth for DoorDash, Uber Eats, ElevenLabs, Stripe, Twilio.

  • Webhook Configuration
    Debugging failed callbacks, managing .env securely.

  • Real-Time Data Orchestration
    Ensuring sync between Supabase, UI, and third-party APIs.

  • UI/UX Complexity
    Responsive, animated UI with Framer Motion and Tailwind CSS.

  • Mocking APIs for Dev
    Simulated delivery and autocomplete logic.


Accomplishments that we're proud of

  • ✅ Built a fully conversational AI ordering assistant
  • ✅ Integrated third-party and simulated drone delivery systems
  • ✅ Robust Stripe + Twilio authentication and payment flows
  • ✅ Clean, type-safe ES module codebase
  • ✅ Stunning responsive UI with 3D cards and glassmorphism
  • ✅ Intelligent user profile flow for new/returning customers
  • ✅ Thorough documentation for future devs

What we learned

  • 🧠 TypeScript debugging and best practices at scale
  • ☁️ Serverless architecture with Netlify Functions
  • 🔐 API key, rate limit, and fallback strategies
  • 🔄 Real-time sync across frontend/backend/APIs
  • 🎨 Advanced animations and layout control
  • ⚙️ Environment variable and secret handling
  • 🔍 Iterative debugging and QA workflows

What's next for SpiceVoice

  • 📊 Advanced Analytics Dashboard
    KPIs, predictive insights, customer behavior analytics

  • 🔔 Firebase Push Notifications
    End-to-end communication via push

  • 🗺 Live Google Maps Integration
    Real-time address, geocoding, and delivery optimization

  • 🥘 AR Menu Preview
    3D visualization of menu items

  • 🔐 Voice Biometrics
    Personalized, secure login experience

  • 🧑‍🍳 IoT Integration
    Sync with kitchen appliances for smart routing

  • 🏪 Multi-location Support
    Manage multiple restaurant branches centrally

  • 🌐 Expanded Language Support
    More Indian languages and improved NLP

  • 🧠 Advanced Menu Customization
    Dynamic pricing, modifiers, and AI recommendations

Built With

Share this project:

Updates