I had always wanted to be able to use the internet to get information about the things around me in a very effortless way. Becuase some of the sponsors for the event work with AR (Augmented Reality) I realized that AR could bring the idea to life.

What it does

Google AR allows you to hold up your phone to scan your environment then the user can directly search the elements in the surroundings with google.

How I built it

Using the open source Abbyy OCR Library for android, I constructed an app that scans your environment for text reads it then allows the user to swipe over the text elements to search them.

Challenges I ran into

I ran into many challenges while using Android Studio. Including broken build tools. (I also had no android phone myself so I had to borrow one). Additionally, I ran into problems with the OCR mapping, despite this I have still managed to create an app that allows you to search up the text in the user's surroundings.

Accomplishments that I'm proud of

The accomplishment that I am the proudest about is, that despite never using android before, I have created an app that is functional.

What I learned

I learned how to work with Android, and gained a better grip on tackling tough problems when I ran into challenges.

What's next for Google AR

  • Image description (add informative captions to pictures your phone sees)
  • Integrated Tool Tips (Tooltips with snippets of result information appear directly on your screen over the objects)

Built With

Share this project: