Heimdall

Heimdall is an AI multi-agent service that helps patients call multiple healthcare providers and book the earliest appointment—saving time and effort, especially when they’re unwell!

Comment

🧠 Inspiration

Booking a doctor’s appointment shouldn't feel harder than being sick. Millions of people still rely on manual phone calls, face long wait times, and waste energy navigating disconnected systems—when all they really want is help. Heimdall was born from the idea that AI should reduce friction in moments of vulnerability.

🚀 What it does

Heimdall is an AI-powered, voice-first multi-agent system that:

  1. Collects patient information (name, DOB, insurance, ZIP, symptoms) via phone
  2. Saves it securely to a database
  3. Automatically calls multiple healthcare providers
  4. Books the earliest available appointment
  5. Optionally sends confirmation via SMS

All while the patient rests.

🏗️ How we built it

  • FastAPI: Webhook backend for VAPI voice agents
  • VAPI.ai: Voice interface for both patient intake and hospital booking
  • SQLite: Lightweight database to persist patient and call data
  • ngrok: Local tunnel for testing webhook callbacks
  • Twilio (optional): For SMS confirmations
  • OpenAI (optional): For fallback GPT-powered question logic

🧩 Challenges we ran into

  • Forcing VAPI agents into webhook-only mode to avoid LLM interruptions
  • Managing session state across two live agent conversations
  • Handling edge cases like dropped calls or incomplete inputs
  • Debugging outbound call flows and telephony permissions
  • Ensuring persistent memory to avoid asking the same question twice

🏆 Accomplishments that we're proud of

  • Seamlessly coordinated two AI agents to handle a real healthcare workflow
  • Built and tested a working MVP with real calls, data logging, and SMS
  • Enabled structured voice-first input from patients without requiring screens
  • Created a modular backend that can scale across providers and cities

📚 What we learned

  • Voice automation in healthcare must be bulletproof, not just clever
  • Patients value simplicity over flash — one clear phone call > app download
  • Webhook-first voice agents give developers real control (unlike prompt-only)
  • Even basic tasks like collecting a ZIP code are full of real-world edge cases

🔮 What's next for Heimdall

  • ⏰ Integrate with Commure's AI call center — so we can finally have AI calling AI 🤖📞
  • ⏰ Add hospital availability APIs for instant booking decisions
  • ⏰ Build a unified patient portal to view appointments and records
  • ⏰ Expand multilingual support and improve accessibility
  • ⏰ Launch a pilot program with real clinics or urgent care chains

Built With

Share this project:

Updates