Suggest, Recommend, & Summarize

AI tool as a chrome extension that makes recommendations based on the patient medical history report, uploaded as a pdf or txt.

Comment

Inspiration

Some medical terminologies in a medical report or a legal document is hard to understand. Hence an AI tool that suggests, recommends, while summarizing with key insights has the scope to provide a general reference and guidance for the patient and their relations.

What it does

The tool lets the patient or the relative upload the pdf or text document. It extracts the contents of the document in a text area. Once the user presses the "Summarize text" option, the tool goes to the ai server and gets the required authentication and generates key recommendations and suggestions. There is also an option to print and email suggestions.

How I built it

The ai tool is a chrome extension that has the frontend designed with javascript. The javascript program calls the AWS Lambda serverless application to get the authentication key and sends the encrypted file via api gateway to the javascript application. The authentication key is decrypted and used to retrieve access to the Open-AI gpt-4.0 model. The prompt for the model is restricted to suggest, summarize and provide key insights for just medical and legal documents.

Challenges I ran into

  1. Researching the right model with appropriate parameters settings on the input and output characters.
  2. Extend the upload file format from basic 'txt' file to pdf and finding a way to incorporate external dependencies in the javascript file.
  3. Engineer the prompt to provide optimal results.

What we learned

Learned about advanced capability of Open Ai model with right parameter settings.

What's next for Suggest, Recommend, & Summarize

Use Open AI's or integrate with third party tool to provide correct infographic or image as guidance for simplicity.

Built With

Share this project:

Updates