Nourish

Inspiration

Our partner Ishaan working at the Houston Food Bank motivated us to implement a solution where we connect our technical skills and also work toward a socially moving product.

What it does

A hardware solution to boost community food deprivation awareness and elimination through implementation of CV, sensors, gamification and incentives.

How we built it

We evaluated our ideal product with what we were given and with what resources we could scrape from around us. So we shopped around our idea pitching the impact to local food stores to borrow their fridge for our product if they resided with our idea. Ended up working great and got a fridge to use physically the entire 24 hours. We then built our solution with an Accelerometer to prevent theft or breaches, moisture sensor to detect leaks and spills, temperature sensor to tell if the fridge may be off, and an air quality sensor to detect molding and expiration. We used 2 cameras one facing the client to identify and store the object and the second facing inside the fridge to verify placement and security. We used a JBL speaker to allow ElevenLabs to be enhanced and clear when speaking to clients, and integrating personal voices to increase familiarity with the system, and multilingual system to adapt to a plethora of situations. We used TigerData to collect sensor data, track inventor, reference CV, and consolidate all of that into one confidence score system. Gemini API and OCR and metadata scraping to find stock images of inventory for user interface ease. Solana to gamify and incentivize the process, integrating it with a Paper.io like map and leaderboard system.

Challenges we ran into

-Rasberry Pi failing, hardware scarce (RFID), Arduino an temp sensor disagreement, API limitations, consolidation and merging errors, CV bottlenecks and webcam speed issues, frame issues, much more we can't think of.

Accomplishments that we're proud of

Integrating almost every track and having the end solution be extremely complex and working toward a real world solution we have experience in and also believe in.

What we learned

Time creeps up extremely fast, learning what to prioritize and what not to, learning to work paralell and distribute work evenly, and providing work in sections to those with experience in said section.

What's next for Nourish

We seriously believe in this project and its scalability, and have even thought of moving this to a project we continue even outside of codeRED, but for short term solutions, a locking mechanism with a motor, and tap to pay with RFID for donations with Solana.