Inspiration

After a doctor's appointment, it’s surprisingly easy to forget when to take a medicine, the right order of instructions, a test you were supposed to get, or an important detail the doctor mentioned. For elderly patients and people dealing with serious or complex conditions, missing even one thing can matter.

We thought: what if your doctor's consultation could stay with you?

What it does

CareRecall turns the doctor's voice into a structured care plan and acts as a doctor's assistant available 24/7.

You can ask it questions about what the doctor said, and it answers from the consultation. It also works like a little personal nurse, helping you remember medicines, tests, and appointments through reminders.

How we built it

We built the frontend with React, Vite, and Tailwind CSS, and the backend with Flask.

We use Groq Whisper for transcription, Gemini for extracting care instructions, and RAG to ground the assistant's answers in the actual consultation.

Challenges we ran into

The biggest challenge was making sure the assistant stays grounded in what the doctor actually said instead of making things up. We also had to deal with voice transcription, structured extraction, RAG, and deploying a memory-heavy AI stack on limited resources.

Accomplishments that we're proud of

We turned a simple voice recording into something genuinely useful: a consultation you can come back to, ask questions about, and set reminders from.

Seeing CareRecall actually answer questions from the consultation and trigger reminders was probably our favourite part.

What we learned

We learned that building a useful AI product isn't just about the model. The context, retrieval, and user experience matter just as much.

We also learned a lot about connecting speech-to-text, LLMs, RAG, and real-world workflows into one application.

What's next for CareRecall

We want to make CareRecall more reliable, support multilingual conversations, improve voice interaction, and make reminders smarter.

The long-term goal is simple: make sure patients don't have to remember everything their doctor said.

Built With

Share this project:

Updates

Submission history