Inspiration
Doctors waste lots of time creating clinical notes and writing details of interactions with the patient. We can automate the transcription and also suggest notes based onthe clinical database.
What it does
It gets clinical interaction with patients and then search clinical history data and based on evidence suggests the SOAP note.
How we built it
To build, start with whisper.AI to record the verbal speech to text, then after that, use Gemini API to call Gemini with notes and RAG-based clinical data to generate the correct SOAP-based note. That docter will be able to use and process the treatement and digonose also add reference to clinical data.
Challenges we ran into
Correct translation of speech and also correctly identify docter and patient.
Accomplishments that we're proud of
A runnable sub-app that can be seen and used to see effectiveness of complete system once ready.
What we learned
How to process different domains issue using gemini.
What's next for Gemini-based SOAP
Integration of verbal speech and automatic search of clinical database.
Built With
- javascript
- vercel

Log in or sign up for Devpost to join the conversation.