Help the visually impaired navigate their computers
What it does
Converts the text in images to braille for the visually impaired to read.
How we built it
Our application uses a micro controller from Maxim Integrated (MAX32600). We used Google’s Cloud Vision API to obtain text from images . We then filtered this text to extract the relevant information and parsed it to braille . Lastly, we fed the MAX32600 micro controller the relevant strings containing binary and it flashed the corresponding LED’s on the controller (in lieu of a board with springs that responds to the braille code received). We upload images to the web application and it communicates through serial with the micro-controller.
Challenges we ran into
Coding and setting up the maxim hardware (micro controller), getting pyserial to work with the web-app, and using cloud vision API for the first time. Cold pizza and spicy red sauce!
Accomplishments that we're proud of
Finishing our first big hackathon! Working with things we’ve just learnt.
What we learned
To use Cloud Vision API , Program Maxim Integrated micro controller(MAX32600) using mbed
What's next for Braille Board
Build the mechanical board Automatically capture screen Make a desktop app