WorldReader is an android application which continuously captures images of your surroundings, pipes the image data through a machine learning algorithm, and then reads information about what you are looking at out loud. In good lighting conditions, it can reasonably identify and categorize any object.
Here's how it works:
Press the volume keys to start or stop the continuous capture process. While running, WorldReader will continuously take pictures of your surroundings. After compressing and processing the images, it sends them to an API for recognition and categorization. The app then parses the API response and uses a TTS engine to read the best guesses out loud.
Log in or sign up for Devpost to join the conversation.