Inspiration
Whoop for waste! Like how Whoop collects data and uses analytics to get people to understand and improve their habits towards their health, we wanted to use Meta Ray Bans to collect data and use analytics to get people to understand their own personal impact on environment.
What it does
Native iOS app that looks through your Meta Raybans' camera to track how much single use- and reusable items you use everyday. It builds dashboards and shows your total environmental footprint and encourages you to use more reusable items to lower your footprint
How we built it
We used Meta Ray-Ban Glasses to take video and processes it through a computer vision that classifies trash. We then put another classifier that determines whether the items are single use or reusable. Then we do data analytics on it and use simple rules to compare the resources they saved to real life understandable amounts.
Challenges we ran into
Getting the Ray-Ban Glasses video to output to the phone. Getting the computer vision to see the Ray-Ban Glasses video, Making a computer vision model that is accurate and making it unable to count the same piece of trash multiple times
Accomplishments that we're proud of
Joined late, did another hackathon in the middle, then stayed all night to get this one done. Finally debug the Glasses
What we learned
AI is bad at using new libraries/SDK can't rely on it.
What's next for Troop
Better trash and alternative detection. More advanced analytics. A release on app store??
Log in or sign up for Devpost to join the conversation.