MDHelper

What it does

It's an app that allows patients to better communicate with their doctors. Let them know ahead of their scheduled appointment with what's wrong. Interact with the 3D avatars and create scene snapshots with the interactive tools to let your doctor know where the uncomforting problems are. You can also add notes / medication you are taking which will go through AWS's Medical Comprehend to provide medical insight which will assist the doctor.

How we built it

Built on Android with Java. The backend is running nodejs, express. Sceneform for the 3D model rendering.

Amazon services used: AWS Textract Java SDK, javascript SDK for Medical Comprehend, and AWS SES (simple email service). Blender for the 3D models.

Challenges we ran into

I wanted to use the Medical Comprehend on images for patient medication, but they didn't support images. I ended up feeding the images into AWS Textract to get the text and then used that output into comprehend and that worked perfectly. I could not get the example for Java SDK for Medical Comprehend to work (maybe because it's a bit outdated updated 3 years ago), so I ended up setting up a nodejs backend in order to use the javascript SDK and it worked well.