Canarea

Our logo
The Canarea Stick

Inspiration

43 million. That’s the number of people in this world who are born blind. With no vision, their only way to navigate the world is by using a flimsy walking cane to feel around them. Our product, Caneria, aids these handicapped people by helping them see the world.

What it does

We have attached a phone camera to a walking cane and added a button by the handle. Upon clicking the button, the camera will click a photo and send the image to our ChatGPT-integrated-model. The model will identify the objects and play an audio through bluetooth to a speaker or to headphones notifying the user what is in front of them. Helping blind people navigate the world. Elevating vision beyond sight, Caneria.

How we built it

We created our image recognition code through python paired with a ChatGPT AI API key, and then integrated this into an HTML website which can be easily accessed by the user. We used a custom walking stick with an attached phone holder, bluetooth speaker, haptic motor, and button. When the user pushes the button, the code on the website runs, and uses the phone camera to determine what the user is pointing the c

Challenges we ran into

Some challenges that we ran into was actually identifying a way to identify the objects. After much deliberation and discussion on the matter, we decided to use an API key from ChatGPT to help us identify the objects in the image.

Accomplishments that we're proud of

One major accomplishment that we are extremely proud of is integrating the API into our model. It took us a majority of the hack to finally learn and apply the syntax of GPT API to finally get our model to work. We are also extremely proud of the final result.

What we learned

We learned a lot of things, including API Key integration, image capturing, and we learned how to transfer data from a phone to our application(This was very tedious.)

What's next for Canarea

Next, we're going to make Canarea an all inclusive app for blind people. We want to include GPS weather and an AI companion for the users. Including GPS allows us to help blind people navigate the world and get from destination to destination. An AI companion can also serve as an extremely helpful tool to assist the blind. Eg. Telling the Weather, Warning of nearby dangers to visually impaired, incoming cars, etc.