Scribo

Inspiration: Ryan during visits to a doctor during the summer noticed that the doctor either spent excessive amounts of time taking notes during the appointment or had a hired medical scribe. Upon further research, he discovered that this was actually a much bigger issue than it seemed. Not only was human note-taking flawed in some cases, but doctors nationally were spending an excessive amount of energy and time on it, severely affecting their ability to serve more patients as well as the quality of their service. Moreover, patients were having an even more unfulfilling experience, with most staying perplexed or confused about their transcriptions due to a lack of understanding of medical jargon.

What it does: Scribo is a Smart Healthcare Assistant for doctors and patients that is capable of generating Medical Scribe Charts and Transcription from audio recordings of conversations between doctors and patients. Scribo also enables the patient’s Medical Record Organization in one place for both doctors and the patients themselves, while Scribo's smart medical chatbot addresses real-time queries and concerns for the patients as they go over their appointment’s scribe chart and transcript.

How we built it: ........

We built it using NodeJS & Express for the backend, Vite + React for the frontend, and Postgres for the database. We also used OpenAI's GPT-4 API to create summaries and Google Cloud Speech-To-Text API to create transcriptions.

Challenges we ran into: //

When we were building the API, we had to integrate different SDKs for GCP and OpenAI. The documentation for GCP was very bad and we had trouble figuring out how to integrate it and setup the client correctly.

Accomplishments that we're proud of: //

Working smart medical chatbot. Streamline physicians' tracking of patient health data. Working platform for both doctors and patients.

What we learned: //

How big of an issue scribing and transcribing is and how big of impact solving it can have. How to integrate GPT-4 into a project and how to use Google Cloud.

What's next for Scribo: ///

Provide explanation on obscure medical terminologies (and in multiple languages); Multiple languages and improved accessibility; Making schedule with appropriate doctors online; Integrating lab reports to make the Scribe Charts and Transcriptions more comprehensive, industry compliant and in E.R.M format.