LeARn

logo
iteration 1
iteration 2

Inspiration

One problem our group faced is that we all want to learn a new language, however, there are way too many non-interactive learning tools for languages. Our group decided to use cutting edge technology in order to make a language learning tool fully inclusive and enticing for beginners. This tool could not only be used by students, but teachers, as well as medical patients going through physical therapy. Coming together as a group for this hackathon, we had the opportunity to bond and share the different cultures that we came from and the different languages that we grew up speaking and learning. We were inspired to improve current language apps by building leARn, a more interactive way of learning how to write in languages in an augmented reality environment.

What it does

An iOS mobile app that uses cutting edge AR technology to augment a fully immersive learning experience. This app has the ability to translate languages on the cloud and delivers an augmented reality with the translated text anchored to surfaces. Users can trace AR generated stencils to easily engage with the written language.

How we built it

We built this application with Swift and the ARKit and utilized Microsoft Cognitive Services Translator Text API for the translations.

Challenges we ran into

One of our biggest challenges was finding a mutual language or framework that we were all familiar with. We ended up using Swift which only half of our team was slightly familiar with. We also spent a lot of time working in the AR environment and trying to anchor the text to surfaces. What we found out was that it was really hard for our program to pick up a dark surface.