DiagnosX

Inspiration

For 4.5 years, I worked in the Emergency Department of a Level II Trauma Center. I witnessed firsthand how medical conditions, such as High Blood Pressure, caused Heart Failure when exacerbated and left untreated. For a while, I believed this was secondary to the patients, not taking their health serious. Truthfully, they presented to the hospital because they wanted to live, our healthcare system simply failed to present critical information to them in a way they could understand. In the USA, 100% of physicians are highly educated. Only 36.5% of Americans have at least a bachelors degree according to a study by the census in 2019. I noticed that the information seemed to get through to the patients when doctors would draw out information on paper or dry erase boards. Although they have the best intentions, physicians are often not artists and only have a certain amount of time to spend with a patient. A solution was needed to combat this disparity along with the impending physician shortage.

What it does

DiagnosX is a HIPPA compliant medical application that uses Microsoft Bot Framework, Botbuilder SDK, Node.js, & LUIS to pull pertinent patient medical information from physicians documentation. This information is then paired with 3D models to illustrate patient's diagnosis and medical history for thorough understanding. The interactive 3D models isolate the body system in question, for a full 365 degree view and marks critical regions pertinent to the medical condition. Patients can view the models of their diagnosis 24/7 and fully break down all aspects of their medical condition.

How we built it

DiagnosX was built using Microsoft Bot Framework, Botbuilder SDK, Node.js, & LUIS for analysis of patient medical records for full information coverage of all patient medical condition. The Three.js Javascript library was also leveraged for rendering of 3D models. GSAP library was also used for interactive and immersive animations of the body systems.

Challenges we ran into

I have been considering turning DiagnosX into an extension for current EMR systems. This was my first time using Microsoft Bot Framework and it was exceptionally easy to setup but I ran into issues dynamically loading responses. To have a working prototype, I did hardcode the patient's questions and responses from the system. Since I would like to fully develop this on the Azure platform, I would like to play around more with the Azure Health Bot, speech to text for the more personal feel, and speech translation for breakdown of diagnosis in patient's native language.

Accomplishments that we're proud of

Having a functional prototype and getting an idea with the potential to impact millions via decreasing disparities in healthcare out there.

What's next for Diagnosx

1) Adding text to speech for a more connected experience. The application reading out information makes it feel slightly more like engaging with the doctor.

2) Getting models of every part of the human body. For the prototype, I just used a human model and the heart but I plan on having a detailed model for each organ of the body.

3) Add more animations to illustrate prognosis of medical condition as well as concerning symptoms.

4)Include 3D models of drugs to illustrate how they interact with the body.

Built With

• botbuilder-sdk
• luis
• microsoft-bot-framework
• node.js