PinPoint

The customer can simply say "tomato sauce", and the exact location of the item will be displayed on the screen.
The screen the manager sees when adding new items to their shelves
Login page for the manager

Inspiration

Have you ever walked around a grocery store, frustrated and unable to find what you're looking for? We wanted to solve this problem by developing an app that would help customers find the exact location of the product they want.

What it does

Our application is made to be integrated within a grocery or department store to allow customers to search for the exact location of a product they are looking for. They must simply speak the name of the item into the mic, and it will tell them the exact aisle, section of that aisle, and shelf that the item can be found at. On the manager side, they can add products to their shelves by simply logging in and inputting the coordinates of the item.

How we built it

We designed the app in Android Studio using XML and Java. On the manager side, when they add items to their shelves through the app, the information is appended to the end of a text file on the device with a FileOutputStream. The user can then search this text file using the Android Speech to Text API. If the name of the product is found, it prints the exact location on the screen.

Challenges we ran into

We had trouble integrating the Android Speech to Text API with the app. It was also our first time using Android Studio and XML, so we spent a lot of time on the Internet learning how the two worked.

Accomplishments that we're proud of

We're proud that we managed to integrate every part of the project that we initially set out to do. Each member of the team contributed a lot on different aspects of the application, be it in the speech-to-text integration or writing new items to the files.

What we learned

We learned the basics of how to use Android Studio and XML to create an application. We also got experience in integrating an API with Android's Speech-to-Text API.

What's next for PinPoint

We will continue to add features to our application, such as the ability to know the price of your cart before getting to the register.

Built With

Submitted to

HackDartmouth V

Created by

In the front-end, I worked with XML on the design of the manager's page for inputting new items. Then, in the back-end, I figured out how to output this information to a text file using Java. It was my first time using Android Studio, so I learned a lot this weekend.

Kai Washer
I worked on the back end to integrate Android’s Speech to Text API using Android Studio. Also, I worked on the front end to make sure that everything was placed properly on the page and that the user had no difficulty navigating our app.

Kevin Marsolais
I worked mostly on the back end, concentrating on implementing Android's built-in speech to text functionality, as well as coding the message to the user showing the location of the item.

Ashwin Philip
kshahi