Inspiration

Maintaining one's health is important and hence self diagnosis of minor ailments or getting an insight for general health-related queries is one step closer to maintaining ones health. Hence, the app "image diagnos" .

What it does

"Image Diagnos" is a chrome extension app that uses AI technology to scan the image uploaded by the user and provide general health related insights. The image has to be uploaded by the user. The image has to be a .jpg file, and can be image of the damaged skin, a feet or eyes or some skin lesions the user is having problem with. The AI analyses the image and gives possible and general health related tips.

How we built it

he application was built as a chrome extension using OpenAI and Amazon AWS with Node.js. When an image is loaded and "Diagnos Image" is pressed, it generates a general diagnosis based on the image. The app uses OpenAI's vision API to provide a diagnosis. Amazon AWS Lambda function has the OpenAI keys.

Challenges we ran into

One main challenge was to figure out where to store the Open API key as it involves retrieving and showing it in the web browser. Amazon Lambda with Node.js and useful packages with encryption and decryption capabilities are used to retrieve the key and display motivational text.

What we learned

Capabilities of OpenAI

What's next for Image Diagnos

An additional option to just snap a photo from the computer and use it.

Built With

Share this project:

Updates