Inspiration

What it does

How we built it

Challenges we ran intoInspiration

I was inspired by how much time and care is lost to repetitive intake questions, busywork, and paperwork in hospitals. Patients want a more human, warm, and efficient experience—and staff want time back to focus on real care.

What it does Vitals is an AI-powered pre-screening tool that has natural voice conversations with patients, collects medical history via PDF, and creates a beautiful, actionable report for doctors. It automates insurance and sick leave forms so doctors can approve with one click.

How we built it We used React + TypeScript + Tailwind for the web app, Google Gemini for warm, adaptive conversation, ElevenLabs for realistic voice synthesis, and pdfjs/Tesseract.js to parse uploaded health records. Our doctor dashboard pulls all data into a friendly interface.

Challenges we ran into The hardest problems were: making the AI conversational, not robotic; extracting useful info from messy PDFs; and keeping the whole experience fast and easy for both patients and doctors.

Accomplishments that we're proud of We created a working MVP with full end-to-end flow: a real patient interview, real data extraction, and real doctor review. Our app saves staff time and feels genuinely pleasant to use.

What we learned We learned how to design better voice UIs, make AI less repetitive, extract context from unstructured medical documents, and obsess over every touchpoint for efficiency and warmth.

What's next for Vitals Integrate even more languages, improve PDF accuracy for scanned docs, add deeper EHR integrations, and pilot in real clinics. Ultimately, bring Vitals to every hospital that wants to spend less time on paperwork—and more on people.

Accomplishments that we're proud of

What we learned

What's next for Vitals

Built With

  • react-typescript-tailwind-css-google-gemini-api-elevenlabs-api-pdfjs
  • tesseract.js
  • vercel
+ 1 more
Share this project:

Updates