We wanted to build something that would aid children in their education and learning process

What it does

Using the phone's camera we built an AR system that would automatically scan for words and if it would match any of our pre-defined words a 3D Model representation of that word would appear in the AR

How we built it

We used Unity3D and Vuforia

Challenges we ran into

  • Vuforia requires that you build 3D Models on Image Tracker which are usually grayscale images but we wanted to use words instead
  • We wanted to select a word out of a paragraph of multiple words and identify successfully
  • We wanted to be able to identify multiple words at the same time and generate multiple models

Accomplishments that we're proud of

We were able to have multiple models generated for multiple words, but as the models collided with each other we fell back to single models

What we learned

We learned new techniques to work with AR and the Unity3D and Vuforia packages

What's next for TextRecognitionAR

Multiword 3D modelling in space to better represent the models

Built With

Share this project: