Hello Fridge

Landing
Food scanner
Food scanner
Food recommendation
Prototype
Food inventory
Electric bill calculating with real time sensors

Inspiration

The idea for Hello Fridge came from the common problem of food waste. Often, people forget about the food they buy, leading to a fridge full of rotten items. We wanted to create a solution that helps users keep track of their food and suggest recipes based on what's available, ensuring ingredients are used before they spoil and reducing food waste.

What it does

HelloFridge is a smart refrigerator with an integrated camera to scan and identify the food items inside. It then utilizes the Gemini API to analyze the food and retrieve details such as each item's name, weight, and category. By also considering the user's emotions, Hello Fridge suggests personalized recipes that cater to both the available ingredients and the user's mood.

How we built it

Hardware Integration:

We installed a high-resolution camera inside the refrigerator.

Image Processing:

The camera captures images of the food items, which are then processed using computer vision techniques.

Gemini API:

The processed images are fed into the Gemini API to extract detailed information about each food item, including its name, weight, and category.

Emotion Detection:

We implemented an emotion detection system that can analyze the user's facial expressions or input to determine their current mood.

Recipe Suggestion:

Combining the data from the Gemini API and the emotion detection system, Hello Fridge generates recipe suggestions that align with the available ingredients and the user's mood.

Challenges we ran into

I couldn't figure out to use Intel cloud as a backend.

Accomplishments that we're proud of

Finished it on time
Identify food and snack accurately with expiration date
Provide food suggestion and recipes for based users convience
Food recommendation based on users mood
Help users to save electric bill and motivate to them to be good influence for the climate change
Assit users to recycle food waste

What we learned

Going into this project, none of us had extensive development experience. As such, we all learned about the Nextjs Server side rendering front-end, Flask backend, IoT endpoints stack sharpened our development skills. Additionally, we learned a whole lot about hardware and software integration.