Inspiration
## Inspiration
For millions of local service businesses—such as hair salons, dental
clinics, auto repair shops, and spas—the telephone is their primary lifeline to revenue. However, small business owners face a painful daily dilemma: when a stylist is mid-haircut, a dentist is treating a patient, or a mechanic is under a vehicle, the phone rings unanswered.
* **Over 40% of inbound customer calls** to SMB service businesses go
unanswered during peak operating hours. * An unanswered customer rarely leaves a voicemail—they simply call the next business on Google Maps, costing shop owners $35 to $150+ in lost revenue per missed call. * Hiring a full-time human receptionist costs $2,500 to $3,500+ every month, which is financially out of reach for a 1-to-5 person shop.
We built **FrontDesk AI** to democratize autonomous AI employees for
everyday small businesses—creating a 24/7 intelligent receptionist that answers every customer call and message instantly, understands pricing and service inquiries, prevents double-bookings by verifying live calendar availability, and confirms real reservations in seconds.
## What it does
**FrontDesk AI** operates as a complete, AI-native front-office
receptionist and scheduling system:
1. **24/7 Voice & Web Chat Receptionist:** Customers can type or speak
directly using interactive browser Voice Mode (speech-to-text +
realistic natural text-to-speech audio synthesis). FrontDesk AI answers
questions about business hours, exact address and directions, service
menus, and pricing tiers.
2. Autonomous Booking Dialogue Engine: Guides customers step-by-
step through selecting a service, choosing an available date, picking an
open time slot, providing their contact details, and confirming their
reservation with zero human intervention.
3. Real-Time Calendar Conflict Avoidance: Checks existing
confirmed appointments in real time to guarantee that booked time slots
are never double-scheduled.
4. Multi-Vertical Industry Presets: Seamlessly adapts across
distinct small business categories—including Hair Salons (Luxe Cuts
Studio), Dental Clinics (BrightSmile Dental), and Auto Repair
Shops (Apex Auto Diagnostics)—with industry-tailored service menus,
pricing, and operating rules.
5. 1-Click Calendar Sync (.ics): Generates universal iCalendar (.
ics) downloads upon confirmation, allowing customers to add their
appointment directly to Google Calendar, Apple Calendar, or
Outlook.
6. Executive Owner Dashboard: Business owners get real-time
tracking of completed revenue, active booking pipeline values, customer
conversation volumes, an autonomous AI handling rate (100%), and a
Live Agent Reasoning Log showing every micro-decision made by the AI.
## How we built it
We engineered **FrontDesk AI** with an enterprise-grade, fully type-
safe modern stack:
* **AI & Language Understanding:** Powered by **Google Gemini API**
(gemini-1.5-flash / gemini-2.0) for fast intent recognition and
natural language parsing, backed by a deterministic dialogue state
machine that guarantees 100% reliable transaction completion without
hallucination.
* Frontend: Built with React 19, TypeScript, and Vite
7, styled using Tailwind CSS and shadcn/ui with 50+ custom UI
primitives. Integrated the Web Speech API for bi-directional
microphone speech recognition and voice playback.
* Backend & API Layer: Powered by Hono on Node.js and tRPC
v11 with SuperJSON, delivering end-to-end type safety from
database query to UI component.
* Data Layer & Persistence: Managed with Drizzle ORM schemas
(business, services, conversations, messages, bookings,
agent_logs) and a zero-latency in-memory data store with sub-10ms
query speeds.
* Cloud & Infrastructure: Designed for deployment on Google
Cloud Run.
## Challenges we ran into
1. **Eliminating Hallucinations in Financial & Booking Decisions:**
Generative LLMs can occasionally hallucinate dates, propose non-existent time slots, or promise arbitrary discounts. We solved this by architecting a hybrid system: Google Gemini handles natural language extraction, while a deterministic state machine strictly enforces calendar validation, business operating hours, and official service pricing. 2. Browser-Based Real-Time Voice Synthesis & Capture: Creating a responsive, telephony-like experience inside the browser required coordinating asynchronous Web Speech synthesis, microphone permissions, and live state updates without audio feedback loops or speech overlap. 3. Cross-Vertical Service Flexibility: Constructing a single data model and dialogue engine flexible enough to understand haircut durations, dental emergency exam slots, and automotive diagnostic packages without requiring separate codebase rewrites.
## Accomplishments that we're proud of
* **True 100% Autonomous Operation:** The entire booking
lifecycle—from customer greeting and FAQ handling to database insertion
and confirmation dispatch—runs continuously without requiring human
staff intervention.
* Auditable Agent Reasoning Trails: Every state transition
(service_selected, offered_times, booking_created) is stored in a
live agent_logs table, giving business owners complete transparency
into why the AI took each action.
* Sub-10ms Zero-Latency Execution: Complete elimination of
external database connection bottlenecks, ensuring immediate
conversational responsiveness.
* Full Multi-Modal Experience: Combining voice speech input, audio
voice output, 1-click .ics calendar generation, and real-time CSV
financial exports in a unified interface.
## What we learned
* **Reliability Trumps Open-Ended Creativity for SMBs:** Small
business owners do not want an AI that writes poetry; they need an AI employee that accurately books appointments, respects business hours, and never quotes wrong prices. * Voice Is Essential for Local Commerce: Many customers prefer speaking over typing when scheduling services on the go. Adding real- time voice recognition and audio response drastically increases booking completion rates. * End-to-End Type Safety Accelerates Velocity: Using tRPC v11 with Drizzle ORM and Zod schemas caught contract mismatches instantly at compile time, eliminating runtime API bugs.
## What's next for FrontDesk AI ?
1. **Telephony & SIP Trunking (Twilio / Retell AI):** Connecting
FrontDesk AI directly to physical phone numbers via SIP WebRTC so the AI answers incoming phone calls from landlines and mobiles. 2. Two-Way Google Calendar & Outlook OAuth Sync: Direct bi- directional synchronization with Google Calendar so bookings automatically block off slots on the owner's personal smartphone calendar. 3. WhatsApp Business & SMS Multi-Channel Dispatch: Sending automated SMS appointment reminders, confirmation links, and rescheduling options via WhatsApp Cloud API. 4. Multi-Tenant SaaS Onboarding: Self-serve onboarding enabling any local business owner to upload their price list, set their business hours, and launch their custom AI receptionist in under 3 minutes.
What it does
How we built it
Challenges we ran into
Accomplishments that we're proud of
What we learned
What's next for FrontDesk AI
Built With
- ai-agents
- drizzle-orm
- gemini-api
- google-cloud
- google-cloud-run
- google-gemini
- hono
- node.-js
- react
- shadcn-ui
- speech-recognition
- superjson
- tailwindcss
- text-to-speech
- trpc
- typescript
- vite
- web-speech-api
- zod
Log in or sign up for Devpost to join the conversation.