Inspiration
Dental clinics deal with repetitive but critical conversations every day:
• “What does my X-ray show?” • “Is this urgent?” • “Can I get a refill?” • “What did my dentist say last time?”
Front desks are overloaded, dentists are interrupted, and patients are often anxious and confused. We wanted to build an AI system that could understand patient context, review clinical artifacts, and respond clearly and responsibly- over the phone.
What it does
The Dental Dispatcher is an AI-powered phone assistant for dental clinics.
When a patient calls the Amazon Connect number: 1. Lex manages the conversation. 2. A Lambda orchestrator (dentalnote-lex-orchestrator) retrieves patient context from DynamoDB. 3. Claude on Amazon Bedrock generates a structured, patient-friendly response.
It can:
• Explain X-ray findings in plain language and use structured label reports and overlay images for analysis • Reference patient history for context-aware responses • Handle automatic prescription refill requests • Provide urgency guidance and next-step recommendations
How we built it
1) X-ray Model Training and Analysis Flow
We trained a dental X-ray detection model to classify:
• healthy • caries • impacted • infection • fracture • broken crown or root
Pipeline: 1. Labeled X-ray dataset 2. Object detection training 3. Model outputs structured findings with confidence scores 4. Overlays generated for visualization 5. Reports stored in S3 6. Summaries stored in DynamoDB
Each X-ray produces: • Original image • Overlay visualization • Structured JSON label report • Aggregated findings (count + confidence threshold)
This structured output feeds into Claude for controlled explanation.
2) AI Voice Orchestration Flow
Phone Call → Amazon Connect → Lex bot → Lambda Orchestrator → DynamoDB (patient history + X-ray summaries) → Bedrock Claude → Response back to caller
We separate responsibilities:
• X-ray summarization Lambda • Voice orchestration Lambda • DynamoDB for structured context • Bedrock for natural language explanation
This modular design keeps clinical analysis separate from conversational orchestration.
Challenges we ran into
• Preventing hallucinations in medical-style explanations • Ensuring summaries strictly reflect structured findings • Handling low-confidence detections safely • Keeping phone responses short and calm instead of long paragraphs
Accomplishments that we're proud of
• End-to-end AI phone assistant working with real X-ray artifact data
• Context-aware conversations using patient history
• Structured summarization tied directly to model outputs
• Visual overlays linked to explanations
• Safe and consistent medical-style disclaimers
• Refill request handling logic integrated into conversation
What we learned
• In healthcare use cases, guardrails matter more than creativity
• Structured data + AI explanation is far more reliable than free-form prompts
• Voice UX requires clarity, brevity, and reassurance
• Confidence thresholds are critical in medical AI
• Architecture separation improves safety and scalability
What's next for The Dental Dispatcher
• Integrate appointment scheduling
• Enable live transfer to clinic staff
• Add SMS/email summary after call
• Add multilingual voice support
• Improve model training with more dental categories
• Add audit logging and compliance hardening
• Deploy pilot with real clinics
Future Scope of Visualization
Currently, we generate X-ray overlays with bounding boxes and structured findings. In future versions, we plan to expand visualization into a more interactive and clinically useful system.
Planned enhancements include:
• Color-coded bounding boxes based on confidence and severity
• Confidence heatmaps layered on X-rays
• Tooth-number mapping for structured dental chart integration
• Interactive dashboard with click-to-explain findings
• Historical comparison view across patient visits
• Risk scoring and urgency indicators
• Patient-friendly visual explanations in a portal
• Model performance and drift monitoring dashboard
These improvements will strengthen explainability, clinical trust, and real-world deployment readiness for The Dental Dispatcher.
Built With
- agent
- amazon-connect
- amazon-dynamodb
- amazon-lambda
- amazon-lex
- amazon-web-services
- bedrock
- claude
- gpt
- python

Log in or sign up for Devpost to join the conversation.