Have you ever been lost in a supermarket? Can't find your favorite book in the library and someone takes it away just in front of your eyes? Your life is gonna be changed by ProductFinder today!
What it does
Tell us what you want, either by typing or your charismatic voice. Just a click and we'll teach you how to follow your heart! With the power of augmented reality (AR), the application overlays the indicator of the path to your product onto the images captured by your phone's camera, so you will never be overwhelmed and lost among the goods in the world.
How we built it
In short, by code of course.
We stored the location of goods you want in the server hosted in DigitalOcean. The front end is built with Unity with Vuforia and ARKit. It prompts you to enter the name of the product with text or voice. Voice recognition is achieved by using Microsoft Cognitive service API in cloud. Backend server processes the prompt and returns the path to the product. Vuforia locates the world origin with image anchor. ARKit tracks the motion of phone and leads you to the good you want.
Challenges we ran into
- Bugs: One big earthworm keeps squiggling onto our computers and bothers us.
- Fusion of Vuforia with ARKit.
- Integrating Microsoft Cognitive API with Unity.
Accomplishments that we're proud of
You can really find your product at a click, we promise.
What's next for ProductFinder
Deploy the application to all supermarkets and library and make everybody's life easier.