Inspiration

Providing a meaningful product to the majority of people rather than a specific demographic. We hoped to learn and build relationships while using AI to help build a meaningful product. Main Reference: Bobby Approved app.

What it does

This program has two main functions. The first the use of the camera. The user can use their camera to scan a barcode, and the program will give you a response of whether that product is something that is good for you. The second main feature is our decision engine. This utilizes a simple decision tree to display a personalized message about the benefits or anything hurtful in the product. THIS IS NOT REAL MEDICALLY RESEARCHED DATA, USE/READ MESSAGES CAREFULLY

How we built it

We used Copilot and Junie agents to built the majority of this project with react, expo, TS and JS. We built most of the filtering system with the assistance of AI on our own. The idea and brainstorming was done purely by the team.

Challenges we ran into

At first we were going to implement the usage of LLM APIs to leverage a response according to our filters, but we quickly found out that it is difficult for us to do that with our limited knowledge and free usage cap of most APIs. This is mostly why we switched to a Decision Engine.

Accomplishments that we're proud of

We built a polished program(With AI Agents) that works and is meaningful to a broad audience. We came up with this idea based on other similar scanning apps and figured there were things missing that we could add to make the experience better for users.

What we learned

We learned about how APIs communicate and are fetched. How to leverage Agents to do work for you and build something that works for you. Work as a team to create a well rounded concept. Learn more about how Github version control works, and how to collaborate more efficiently using Github.

What's next for NutriSummary

We believe that if we decided to work more on this, we could develop it into a more robust app, possibly including an LLM that gives the user a more personalized and more specific response to their nutritional needs. Additionally, we could eventually add features for disabilities, like text to speech.

Share this project:

Updates

Submission history