ARgot

Inspiration

Running into language barriers. Needing a more interactive way to learn new languages.

What it does

Uses augmented reality to label things in both the native language, and the selected language. Gives example sentences in the selected language. And allow the user to hear the pronunciation.

How we built it

We used the iOS ARKit to build the app, along with a Python Flask backend API hosted on AWS which communicates with 3 other APIs: the Google Cloud API for complicated translations, the Oxford Dictionary API for example sentences, and IBM Watson for text to speech capabilities.

Challenges we ran into

With a new Apple operating system, we struggled a lot to get our front end up and running. On the back end, we found that the Oxford Dictionary API wasn't especially consistent with the way it responded to requests.

Accomplishments that we're proud of

What we learned

What's next for ARgot

More languages, adding saved phrases functionality for users to review, directly translating text off of written media, expanded library of recognizable objects