NutroPNG

Inspiration

Ordering delivery and eating out is a major aspect of our social lives. But when healthy eating and dieting comes into play it interferes with our ability to eat out and hangout with friends. With a wave of fitness hitting our generation as a storm we have to preserve our social relationships while allowing these health conscious people to feel at peace with their dieting plans. With NutroPNG, we enable these differences to be settled once in for all by allowing health freaks to keep up with their diet plans while still making restaurant eating possible.

What it does

The user has the option to take a picture or upload their own picture using our the front end of our web application. With this input the backend detects the foods in the photo and labels them through AI image processing using Google Vision API. Finally with CalorieNinja API, these labels are sent to a remote database where we match up the labels to generate the nutritional contents of the food and we display these contents to our users in an interactive manner.

How we built it

Frontend: Vue.js, tailwindCSS Backend: Python Flask, Google Vision API, CalorieNinja API

Challenges we ran into

As we are many first-year students, learning while developing a product within 24h is a big challenge.

Accomplishments that we're proud of

We are proud to implement AI in a capacity to assist people in their daily lives. And to hopefully allow this idea to improve peoples relationships and social lives while still maintaining their goals.

What we learned

As most of our team are first-year students with minimal experience, we've leveraged our strengths to collaborate together. As well, we learned to use the Google Vision API with cameras, and we are now able to do even more.

What's next for McHacks

Calculate sum of calories, etc.
Use image processing to estimate serving sizes
Implement technology into prevalent nutrition trackers, i.e Lifesum, MyPlate, etc.
Collaborate with local restaurant businesses