Poor doctor's notes commonly lead to inaccurate diagnosis. We wish to provide a secondary transcript of all the information during the patient's visit so that they can understand their situation, and physician assistants can cross-check their notes.

What it does

Medscribe allows doctors to speak into Google Assistant and produce a SOAP note (Subjective, Objective, Assessment, Plan) which is known as an effective note taking method that most doctors use. The platform takes these notes and summarizes it into a few sentences with all the crucial information. Once summarized, the notes are transferred to the Medscribe website where a profile is created/updated for the patient.

How we built it

Medscribe was built using various languages and APIs. The Voiceflow API is used to get speech to text from Google Assistant. From there, we used the Google Spreadsheets API to transfer the notes to a machine learning model where they are summarized. Then, the summarized notes are sent via a Flask API to a Web App made with React.

Challenges we ran into

Figuring out a solution to implement POST requests from Voiceflow to a database, or an external source such as Google Sheets. We also ran into runtime challenges in the summarizing portion of the project.

Accomplishments that we're proud of

Solving a real world problem that impacts lives.

What we learned

We learned how to use and implement the Voiceflow API, summarize text using machine learning, and how to develop a Web App using React.

What's next for Medscribe

To improve the website by implementing a login system to make it more secure. We would upgrade to a real-time database from Google Sheets, and we would improve our summarizing algorithm.

Share this project: