Project Story: Jayna – Just-in-time Agent for Your Natural Assistance
About the Project
The idea for Jayna came from a frustration we’ve all felt: picking up the phone, only to be trapped in endless menus, transferred between agents, or asked to repeat the same details five times. I realized that despite all the AI buzz, voice—the most natural interface—remained broken in mission-critical industries like healthcare, finance, and logistics. The gap was obvious: customers needed answers now, but organizations had brittle scripts, disconnected systems, and overwhelmed staff.
What Inspired Us
My inspiration came from watching world-class teams sound like yesterday’s call centers. A cardiology patient waiting on prescriptions shouldn’t be stuck on hold. A high-value bank client shouldn’t be locked out for hours because a human couldn’t connect the dots fast enough. I wanted to prove that agentic AI could bring real-time orchestration to the phone itself—fixing revenue, risk, and retention in the moment it rings.
What We Learned
Through building Jayna, we learned that agentic voice automation isn’t about clever answers—it’s about decisive execution. Speech intelligence alone isn’t enough; you need retrieval from trusted systems, real-time orchestration, and compliance guardrails. We also learned how fast modern AI can graduate from hackathon demo to production-grade pipelines when engineered with the right primitives: RAG, planning, and API execution.
How We Built It
We designed Jayna as a product from day one, not a prototype.
- Voice intelligence: Hybrid ASR + LLM reasoning to capture messy, urgent speech.
- Retrieval layer: Secure connectors into EMRs, CRMs, and financial systems.
- Agentic planner: Breaks down intent into multi-step workflows, checks compliance, then acts.
- Execution loop: Posts updates, creates tickets, triggers APIs, and confirms resolution—while the call is still live.
We are next planning to build a HIPAA-aware architecture with PHI redaction, audit logging, and SOC2-ready controls, because credibility matters as much as functionality.
Challenges We Faced
Building Jayna wasn’t easy. We fought latency demons while making real-time retrieval feel instant. We had to tune orchestration so it never hallucinated outside compliance. And the hardest part: making it feel human. Natural pacing, emotional intelligence, and trustworthiness were non-negotiable. Every iteration taught us that voice AI must not just sound smart—it must be operationally reliable.
The Trajectory
Hackathons are our launchpad, not our finish line. We already have design partners lined up in healthcare, fintech, and customer operations. Next steps include live pilots for prescription logistics, fraud escalations, and retention saves. With security reviews underway and investors circling, we’re turning Jayna from a dazzling demo into the AI teammate every operator remembers.
Built With
- elevenlabs
- express.js
- node.js
- openai
- sip
- vonage
- websockets

Log in or sign up for Devpost to join the conversation.