Anne Eye

Inspiration

Disabled people are often left behind by new technology like AI, so we wanted to create an app that is directly tailored towards blind people.

What it does

This app processes image and video input and outputs description or transcription of the input through speech audio. It can also take audio input to create a list, and the AI keeps track of what the user has already found and what groceries the user still needs to find.

How we built it

We used type script for the backend and html for the frontend to provide a basic demonstration. We also used the Vertex AI to assist our program.

Challenges we ran into

We initially had a problem on deciding what type of project we wanted to create, but after a few hours of testing and discussion, we chose this idea. We also had some difficulties making the AI tailored to the purpose of our app (e.g. keeping item descriptions short), which is grocery shopping.

Accomplishments that we're proud of

We're proud of our concept of trying to help a niche audience.

What we learned

We learned how to utilize google Gemini and Vertex AI to supplement our code since we didn't know how to program some parts of our app as beginners.

What's next for Anne Eye

Instead of an app, this program could potentially be integrated with hardware such as smart glasses so it becomes more practical to use for blind people.

Built With

• html
• react
• typescript
• vertex