Alt-Text Generator

the actual extension with the caption that was generated
luke cheng hard at work programming
Our team setup
The future winners of the Gwinnett Hackathon 2024

Inspiration

Blind people aren't able to see images on websites. Alt text makes it so they can get an audio description of the image. Some images on websites don't have an alt text so the program makes an ai generated summary of the image for the alt text. Blind people can then use screen readers that are made already to get a description of the image.

What it does

The program first takes the image and puts it through perplexity to analyze it. Then perplexity will create an ai generated summary of the image for the alt text. The alt text can then be read aloud using a separate screen reader so that the blind people can have an audio description of it.

How we built it

The program was made using Javascript and Python as the back end. Perplexity was used to analyze the image and make a summary of it. The front end was made using html and is a chrome extension so that people can use it easily. When the button is pressed, the alt text is generated.

Challenges we ran into

The program kept malfunctioning and had a lot of bugs. There were also problems with getting the api right. We ran into a lot of errors and sometimes the image would not be analyzed.