This project was originally intended to provide convenience for the patients, to limit contact with others in hospital. We wanted patients to have to wait less time and go through less hoops to see their doctors. Therefore, we made The eDoctor that helps patients fill out information before their appointments to meet with their doctor. However, not all the words stated by the patients need to go to the doctors. Therefore, we wanted to take pertinent information from patient's responses and send them to doctors.
What it does
Our web application allows patients to connect with their doctors, and explain their situations through an online system, by just speaking to the computer, as the web app records their responses, or through text input. We then utilized the OpenAI API in order to summarize the details of the patients response, and email the corresponding doctor their details.
How we built it
We utilized Python for the backend of our web application, and we utilized Streamlit along with HTML and CSS to build the front end of our application. Open AI was used to help process information sent between the patient and the doctor.
Challenges we ran into
We ran into some challenges with the recording voice options at first. This feature took more time than we anticipated. Additionally, we really wanted to host the website on a platform that allows all the features we implemented. However, we were not able to find a service in time.
Accomplishments that we're proud of
We were able to successfully get speech recognition in python to work, to record the responses of patients, and also utilized OpenAI API to summarize the responses. Using OpenAI was an amazing experience and we utilized multiple functionalities to make the project possible.
What we learned
This hackathon was an incredibly positive experience through all the difficulties. We learned a lot from this hackathon such as Streamlit, speech recognition, and NLP with APIs.
What's next for The eDoctor
We would love to implement our idea on an accessible platform to all.