Inspiration

## Inspiration

For millions of local service businesses—such as hair salons, dental

clinics, auto repair shops, and spas—the telephone is their primary lifeline to revenue. However, small business owners face a painful daily dilemma: when a stylist is mid-haircut, a dentist is treating a patient, or a mechanic is under a vehicle, the phone rings unanswered.

* **Over 40% of inbound customer calls** to SMB service businesses go

unanswered during peak operating hours. * An unanswered customer rarely leaves a voicemail—they simply call the next business on Google Maps, costing shop owners $35 to $150+ in lost revenue per missed call. * Hiring a full-time human receptionist costs $2,500 to $3,500+ every month, which is financially out of reach for a 1-to-5 person shop.

We built **FrontDesk AI** to democratize autonomous AI employees for

everyday small businesses—creating a 24/7 intelligent receptionist that answers every customer call and message instantly, understands pricing and service inquiries, prevents double-bookings by verifying live calendar availability, and confirms real reservations in seconds.

## What it does

**FrontDesk AI** operates as a complete, AI-native front-office

receptionist and scheduling system:

1. **24/7 Voice & Web Chat Receptionist:** Customers can type or speak

directly using interactive browser Voice Mode (speech-to-text + realistic natural text-to-speech audio synthesis). FrontDesk AI answers questions about business hours, exact address and directions, service menus, and pricing tiers. 2. Autonomous Booking Dialogue Engine: Guides customers step-by- step through selecting a service, choosing an available date, picking an open time slot, providing their contact details, and confirming their reservation with zero human intervention. 3. Real-Time Calendar Conflict Avoidance: Checks existing confirmed appointments in real time to guarantee that booked time slots are never double-scheduled. 4. Multi-Vertical Industry Presets: Seamlessly adapts across distinct small business categories—including Hair Salons (Luxe Cuts Studio), Dental Clinics (BrightSmile Dental), and Auto Repair Shops (Apex Auto Diagnostics)—with industry-tailored service menus, pricing, and operating rules. 5. 1-Click Calendar Sync (.ics): Generates universal iCalendar (. ics) downloads upon confirmation, allowing customers to add their appointment directly to Google Calendar, Apple Calendar, or Outlook. 6. Executive Owner Dashboard: Business owners get real-time tracking of completed revenue, active booking pipeline values, customer conversation volumes, an autonomous AI handling rate (100%), and a Live Agent Reasoning Log showing every micro-decision made by the AI.

## How we built it

We engineered **FrontDesk AI** with an enterprise-grade, fully type-

safe modern stack:

* **AI & Language Understanding:** Powered by **Google Gemini API**

(gemini-1.5-flash / gemini-2.0) for fast intent recognition and natural language parsing, backed by a deterministic dialogue state machine that guarantees 100% reliable transaction completion without hallucination. * Frontend: Built with React 19, TypeScript, and Vite 7, styled using Tailwind CSS and shadcn/ui with 50+ custom UI primitives. Integrated the Web Speech API for bi-directional microphone speech recognition and voice playback. * Backend & API Layer: Powered by Hono on Node.js and tRPC v11 with SuperJSON, delivering end-to-end type safety from database query to UI component. * Data Layer & Persistence: Managed with Drizzle ORM schemas (business, services, conversations, messages, bookings, agent_logs) and a zero-latency in-memory data store with sub-10ms query speeds. * Cloud & Infrastructure: Designed for deployment on Google Cloud Run.

## Challenges we ran into

1. **Eliminating Hallucinations in Financial & Booking Decisions:**

Generative LLMs can occasionally hallucinate dates, propose non-existent time slots, or promise arbitrary discounts. We solved this by architecting a hybrid system: Google Gemini handles natural language extraction, while a deterministic state machine strictly enforces calendar validation, business operating hours, and official service pricing. 2. Browser-Based Real-Time Voice Synthesis & Capture: Creating a responsive, telephony-like experience inside the browser required coordinating asynchronous Web Speech synthesis, microphone permissions, and live state updates without audio feedback loops or speech overlap. 3. Cross-Vertical Service Flexibility: Constructing a single data model and dialogue engine flexible enough to understand haircut durations, dental emergency exam slots, and automotive diagnostic packages without requiring separate codebase rewrites.

## Accomplishments that we're proud of

* **True 100% Autonomous Operation:** The entire booking

lifecycle—from customer greeting and FAQ handling to database insertion and confirmation dispatch—runs continuously without requiring human staff intervention. * Auditable Agent Reasoning Trails: Every state transition (service_selected, offered_times, booking_created) is stored in a live agent_logs table, giving business owners complete transparency into why the AI took each action. * Sub-10ms Zero-Latency Execution: Complete elimination of external database connection bottlenecks, ensuring immediate conversational responsiveness. * Full Multi-Modal Experience: Combining voice speech input, audio voice output, 1-click .ics calendar generation, and real-time CSV financial exports in a unified interface.

## What we learned

* **Reliability Trumps Open-Ended Creativity for SMBs:** Small

business owners do not want an AI that writes poetry; they need an AI employee that accurately books appointments, respects business hours, and never quotes wrong prices. * Voice Is Essential for Local Commerce: Many customers prefer speaking over typing when scheduling services on the go. Adding real- time voice recognition and audio response drastically increases booking completion rates. * End-to-End Type Safety Accelerates Velocity: Using tRPC v11 with Drizzle ORM and Zod schemas caught contract mismatches instantly at compile time, eliminating runtime API bugs.

## What's next for FrontDesk AI ?

1. **Telephony & SIP Trunking (Twilio / Retell AI):** Connecting

FrontDesk AI directly to physical phone numbers via SIP WebRTC so the AI answers incoming phone calls from landlines and mobiles. 2. Two-Way Google Calendar & Outlook OAuth Sync: Direct bi- directional synchronization with Google Calendar so bookings automatically block off slots on the owner's personal smartphone calendar. 3. WhatsApp Business & SMS Multi-Channel Dispatch: Sending automated SMS appointment reminders, confirmation links, and rescheduling options via WhatsApp Cloud API. 4. Multi-Tenant SaaS Onboarding: Self-serve onboarding enabling any local business owner to upload their price list, set their business hours, and launch their custom AI receptionist in under 3 minutes.

What it does

How we built it

Challenges we ran into

Accomplishments that we're proud of

What we learned

What's next for FrontDesk AI

Built With

  • ai-agents
  • drizzle-orm
  • gemini-api
  • google-cloud
  • google-cloud-run
  • google-gemini
  • hono
  • node.-js
  • react
  • shadcn-ui
  • speech-recognition
  • superjson
  • tailwindcss
  • text-to-speech
  • trpc
  • typescript
  • vite
  • web-speech-api
  • zod
Share this project:

Updates