Inspiration
Whenever I throw something in the trash at UTSC, I notice that the same object will be in all three of the bins. And I myself sometimes wonder: What the bin? It's a paper plate, so it's recyclable, but it has food, so compost? Wait maybe I should landfill this then? But I don't want to landfill, so I'll hope its recyclable -- the problem? -- putting landfill in the recycling bin just contaminates the whole bag.
What it does
So that is what "What the bin" helps you with. By showing your item towards the camera, will tell you which bin. And tell you if you need to empty it before throwing it, if you should take it to a special electronic spot, and more.
How we built it
It was built with HTML/CSS/JS as the front end and Django as the back end. Using the web camera, it creates a dataURL encoded in base64 and sends it to the back-end server, which connects to the Gemini API for vision and descriptions.
Challenges we ran into
It was my first time working with Gemini's API system, as well as using js to access the user's webcamera, so I stumbled around working around with those in order to get them working.
Accomplishments that we're proud of
I'm proud of learning about Gemini's API system, and being able to create something presentable (since this is my first hackathon).
What we learned
I learned a lot about Gemini's API system, working with user media, and various other things relating to JS and images.
What's next for What The Bin?
The next step is to port it into a proper mobile application, that way it is more convenient.
Log in or sign up for Devpost to join the conversation.