One of the ways to learn a new language is to immerse yourself in it by labeling everyday objects with sticky notes. However, with this method, you are limited to common household objects. Language Landscape aims to aid your learning by digitally labeling objects around you.
What it does
Using machine vision and translation, identify and label objects in the environment in both English and a foreign language.
How I built it
I used Google Vision API to identify objects and Google Translate API to translate the words into a foreign language.
Challenges I ran into
Android development was a new topic for me.
Accomplishments that I'm proud of
Finishing the project.
What I learned
What's next for Language Landscape
Being able to calibrate the app against the environment in order to "pin" tags on items. Implementing an audio component to the application. Adding logic to reject overly general classifications.