Healix-Nova: The Autonomous Clinical Workflow Engine

An autonomous clinical agent using Nova 2 Sonic for real-time voice and Nova Act to automate legacy health portal workflows for the sensory-impaired.

Comment

Healix-Nova: The Autonomous Clinical Workflow Engine

Inspiration: Beyond Passive AI

In the Indian healthcare landscape, a prescription is often a "dead end" for blind patients, and a doctor's consultation becomes a "silent room" for deaf patients. Most AI solutions remain passive chatbots—they wait for input and frequently generate dangerous hallucinations.

We built Healix-Nova as an active, orchestrating agent—an autonomous bridge that "sees" for those who cannot see and "acts" for those who cannot navigate the digital world. By 2030, healthcare must be inclusive; Healix-Nova ensures that accessibility never comes at the cost of clinical safety. We are moving beyond the "text-box" to create an agent that doesn't just talk—it executes.

How We Built It: The Frontier Reasoning Loop

Healix-Nova leverages the Amazon Nova 2 portfolio on Amazon Bedrock to manage a high-speed, stateful clinical reasoning cycle.

  1. Deterministic Reasoning Layer ($T=0.0$)
    To eliminate the "Confidence Trap" in medical decision-making, we enforce a strict mathematical constraint within our Nova 2 Lite inference parameters:

$$ T = 0.0 $$

This locks the model into a pure reasoning engine over verified tokens—no creative generation is allowed. This is the cornerstone of our "Clinical Safety First" architecture.

  1. Voice AI with Nova 2 Sonic
    Unlike traditional turn-based apps, we utilized Nova 2 Sonic to create a real-time conversational experience.

Natural Turn-Taking: We implemented barge-in capabilities, allowing a blind patient to interrupt the agent naturally to ask a clarifying question while it is narrating a lab report. The agent pivots instantly, maintaining clinical context without "logic lag."

  1. UI Automation with Nova Act
    This is our "Secret Weapon" for accessibility. Most healthcare portals are not screen-reader friendly. We use Nova Act to function as the patient's "Digital Hands."

Example: If a user says, "Book my follow-up at the eye clinic," Nova Act autonomously navigates the legacy web portal, interprets the UI, and performs the booking on the user's behalf.

  1. The Grounding Hierarchy
    Every action is validated across three high-fidelity knowledge namespaces hosted on Amazon OpenSearch Serverless using Nova Multimodal Embeddings:
  • Pharmacological Agent: Real-time queries to CIMS India for drug interactions
  • Clinical Agent: Diagnostic grounding against MSF Protocols
  • Heritage Agent: Digitized retrieval from RMRL Manuscripts (Ancient Tamil Siddha & Ayurvedic wisdom)

The Multimodal Ecosystem: Inclusive by Design

Every module in Healix-Nova is built with dual-accessibility: real-time voice synthesis for the blind and high-contrast, streaming text for the deaf.

I. The Patient Suite: Empathetic Independence

  • Vision-to-Voice Pharmacy
    Uses Nova's multimodal understanding to read prescriptions, cross-checks with CIMS, and instantly speaks safety warnings.

  • Lab Buddy
    Converts complex biomarkers ($HbA1c$, $eGFR$, etc.) into plain-language summaries with synchronized audio-visual narration.

  • Grandma’s Home
    Digitally preserves 100% citation-backed traditional Indian remedies with full voice and text support.

II. The Physician Hub: High-Stakes Efficiency

  • Universal S.O.A.P. Agent
    Automatically structures patient history into clean SOAP notes, reducing documentation burden by ~40% for all doctors.

  • Seamless Telehealth
    A "Second Opinion Engine" with real-time transcription and voice synthesis, facilitating perfect communication between doctors and any patient, regardless of sensory ability.

  • Glass-Box Logic
    Produces transparent Clinical Logic Trees grounded in MSF Protocols, offering audible narration and visual evidence pathways for every clinical suggestion.

Accomplishments we're proud of

  • Zero-Hallucination Clinical Safety
    Successfully implemented a specialized RAG architecture with a forced temperature of $T=0.0$.

  • True Multimodal Inclusion
    Built a synchronized engine providing high-fidelity Voice for the blind and real-time Text for the deaf.

  • Autonomous UI Navigation
    Deployed Nova Act to bridge the "Digital Divide," allowing sensory-impaired users to interact with non-accessible legacy web applications.

  • Cultural Heritage Preservation
    Digitized and indexed ancient Tamil medical manuscripts (RMRL), making traditional wisdom safe through modern clinical cross-referencing.

Challenges & Learnings

  • The Hallucination Barrier
    For blind and deaf users, accuracy is the only acceptable metric. We learned that "I don't know" is more valuable than a guess.

  • UI Variability
    Training Nova Act to handle the unpredictable nature of legacy Indian healthcare portals required deep agentic "chain-of-thought" engineering.

  • Infrastructure Orchestration
    Moving from local prototypes to a production-grade AWS Bedrock environment taught us the power of scalable, frontier-model deployment.

Impact: Meaningful by 2030

Healix-Nova is healthcare infrastructure for the Next Billion. By bringing blind and deaf users into a secure "Circle of Trust" via Amazon Nova’s frontier intelligence, we are delivering clinical precision and radical accessibility. By 2030, this framework will empower millions to navigate their health with independence and dignity.

Built With

  • cims-drug-database
  • clinical
  • doctr-(vision-ocr)
  • groq
  • javascript
  • msf
  • openai/gemini-api
  • pinecone-(vector-database)
  • python
  • rag
  • restapi
  • tailwind-css
  • transformers
Share this project:

Updates