Running into language barriers. Needing a more interactive way to learn new languages.
What it does
Uses augmented reality to label things in both the native language, and the selected language. Gives example sentences in the selected language. And allow the user to hear the pronunciation.
How we built it
We used the iOS ARKit to build the app, along with a Python Flask backend API hosted on AWS which communicates with 3 other APIs: the Google Cloud API for complicated translations, the Oxford Dictionary API for example sentences, and IBM Watson for text to speech capabilities.
Challenges we ran into
With a new Apple operating system, we struggled a lot to get our front end up and running. On the back end, we found that the Oxford Dictionary API wasn't especially consistent with the way it responded to requests.
Accomplishments that we're proud of
What we learned
What's next for ARgot
More languages, adding saved phrases functionality for users to review, directly translating text off of written media, expanded library of recognizable objects