One of our very close friends is extremely allergic to sesame seeds and unfortunately she spends a lot of her time reading the ingredient lists on packages before she can allow herself to eat it. We wanted to make an application which would allow people with these type of allergies or dietary restrictions to not have to worry about wasting their time doing so and not have to worry about reading the packages inaccurately. Some packaging has small writing, is hard to read, or isn't on a barcode-based database. We decided to attract a broader audience by not only including allergies, but also including people that have particular dietary restrictions. This way everyone can enjoy the food they want to eat without all that time reading the ingredient list.
What it does
We built a React Native App for cross-platform compatibility. Our goal was to improve the quality of life of individuals with stricter than normal dietary restrictions (allergies, religion,personal preferences, etc). The app works as follows. The user is first asked for their dietary restrictions. Our application supports the major dietary restrictions such as vegan, gluten, lactose, peanuts and many others. The user then takes a picture of the ingredient list on the food package.Using the Azure Cognitive Vision API, words are pulled from the image and checked against a database of keywords of the desired restrictions. If a positive match occurs, the user is advised that they should not consume this product. Otherwise, they're good to go.
How we built it
We built this with Node.js on the backend, React-Native on the frontend (app), MongoDB and Azue vision API for OCR.
Challenges we ran into
Our first React Native app Scraping data for the database Data collection was successful but we ran out of time to implement the rendering of the visual interface.
Accomplishments that we're proud of
React-Native is new for us!
What we learned
We learned how to use new technologies such as React Native, Mongo DB, Mongoose DB just to name a few.
What's next for SafeEats.AI
Adding a better UI.