Help the visually impaired navigate their computers

What it does

Converts the text in images to braille for the visually impaired to read.

How we built it

Our application uses a micro controller from Maxim Integrated (MAX32600). We used Google’s Cloud Vision API to obtain text from images . We then filtered this text to extract the relevant information and parsed it to braille . Lastly, we fed the MAX32600 micro controller the relevant strings containing binary and it flashed the corresponding LED’s on the controller (in lieu of a board with springs that responds to the braille code received). We upload images to the web application and it communicates through serial with the micro-controller.

Challenges we ran into

Coding and setting up the maxim hardware (micro controller), getting pyserial to work with the web-app, and using cloud vision API for the first time. Cold pizza and spicy red sauce!

Accomplishments that we're proud of

Finishing our first big hackathon! Working with things we’ve just learnt.

What we learned

To use Cloud Vision API , Program Maxim Integrated micro controller(MAX32600) using mbed

What's next for Braille Board

Build the mechanical board Automatically capture screen Make a desktop app

Built With

Share this project: