According to the U.S. Department of Health & Human Services, "Empty calories from added sugars and solid fats contribute to 40% of total daily calories for 2–18-year-olds and half of these empty calories come from six sources: soda, fruit drinks, dairy desserts, grain desserts, pizza, and whole milk.” This shows the problem of people having to work hard to find a food product that is nutritious quickly. We aim to make people healthy by making it easier for them to find nutritious food easily. This also matched well with Wegman's vision of helping people stay healthy.

What it does

We essentially designed an app that can be used during casual shopping. When is browsing for a product, they can take the app and take a picture/scan the barcode to identify the product? Our app reads the nutrition value and suggests products that are much healthier and are probably just next to this product but you've not noticed! If not, we suggest nearby branches where the product is available and allow you to check out. This single point of sales "check out" allows checking out from nearby stores and from the current store thereby giving the users a lot of flexibility.

How we built it

The mobile application is built on React Native and Expo with some Express backend for persistence and integrated with the Google Vision API on the Google Cloud Platform. We used Wegman's API to build the product.

Challenges we ran into

Using the Vision API for detecting the objects and integrating them with the Wegmans API to build recommendation systems was a real challenge.

Accomplishments that we're proud of

Coming up with a prototype idea that serves the community and shops like Wegmans.

What we learned

We learned a lot about Javascript and the challenges that come with wanting to integrate machine learning into the product for seamless interaction.

What's next

We aim to make the project fully functional with machine learning recommendation systems by integrating how friends purchase and how that might influence purchasing healthy products!

Share this project: