Inspiration

Doctors waste lots of time creating clinical notes and writing details of interactions with the patient. We can automate the transcription and also suggest notes based onthe clinical database.

What it does

It gets clinical interaction with patients and then search clinical history data and based on evidence suggests the SOAP note.

How we built it

To build, start with whisper.AI to record the verbal speech to text, then after that, use Gemini API to call Gemini with notes and RAG-based clinical data to generate the correct SOAP-based note. That docter will be able to use and process the treatement and digonose also add reference to clinical data.

Challenges we ran into

Correct translation of speech and also correctly identify docter and patient.

Accomplishments that we're proud of

A runnable sub-app that can be seen and used to see effectiveness of complete system once ready.

What we learned

How to process different domains issue using gemini.

What's next for Gemini-based SOAP

Integration of verbal speech and automatic search of clinical database.

Built With

Share this project:

Updates

Submission history