SHELFie

Introducing Shelfie, smart grocery tracker and recipe recommender
Stock photo plain background demo
Stock photo realistic background demo
Live Camera Feed Demo
Demo with Gourmet Cuisine @ 4AM
CAD Demos for Hardware Integration
CAD Demos for Hardware Integration

Our Story 💭

The story of Shelfie began with a shared experience among us team members and our respective families. We had all faced issues with produce and products nearing or past their expiration dates in their home fridges, and sometimes encountered products like mayonnaise being way past their expiries. Thus, we set out to create a solution that would help users keep track of the expiration dates of items in their fridge and reduce food waste.

Challenges we faced 🤒

We faced several challenges during development. First and foremost, we all considered ourselves beginners, having only been proficient in Java. However, throughout the course of bit.camp, we learned React and some TypeScript to accompany our web stack. Some other observable challenges included displaying the webcam feed on the website; integrating multiple APIs to allow for primitive image recognition; accurate, helpful recipe generation; and lastly, sleep.

But we overcame them 💅

Shelfie employs advanced image recognition techniques to accurately recognize produce and products with expiration dates. The reminder system, powered by CockroachDB, alerts users when a product is about to spoil or expire. The OpenAI-powered recipe recommendation system suggests recipes based on the ingredients in the fridge and the user's dietary preferences and needs.

What's next for Shelfie 🚀

Looking towards the future, we plan to continue improving and refining our product. By using higher-definition, more efficient image-processing techniques, we can more accurately read and analyze the barcode or product. Integrating GPT-4 or Hugging Face models will allow the software to suggest healthier alternatives to some of the products in the user's fridge. We also plan to integrate it with AI-speaking assistants for recipe retrieval.

Accomplishments that we're proud of 🤠

Learning about OpenCV and tensorflow; integrating Google Cloud Vision; CADing a demo; connecting to OpenAI; using APIs in general. ...and that we love UMD CS and the entire Bitcamp team!