-
-
AuctionEye_UI
-
AuctionEye_UI_1
-
Firestore
-
Architecture
Inspiration
At every flea market, sellers know exactly what their items are worth. Buyers rarely do. That one-sided information gap costs buyers money on almost every transaction. I wanted to fix it — invisibly and in real time — through an earphone.
What it does
AuctionEye is a real-time AI flea market agent with two modes. Scan mode (SPACE): Point the camera at any item → Gemini 2.5 Flash identifies it → SerpApi fetches real eBay sold prices → voice whispers advice in your earphone in under 10 seconds. Live Voice mode (V): Activates Gemini Live API — fully bidirectional voice and vision. Speak naturally while the agent watches your camera and answers in real time. Session report (Q): End-of-day spoken summary — items scanned, best deal, and potential savings.
How we built it
Four focused agents power the system: Vision Agent (Gemini 2.5 Flash), Price Agent (SerpApi → eBay live listings with outlier filtering), Strategy Agent (Gemini 2.5 Flash → BUY / NEGOTIATE / PASS), and Voice Agent (Gemini Live API bidirectional streaming). Every scan and voice interaction is stored in Google Cloud Firestore for persistent session memory.
Challenges we ran into
Getting Gemini Live API working alongside a Tkinter UI on Windows required solving audio thread blocking — the async coroutine and Tkinter mainloop competed for CPU, causing silent audio output. This was solved by isolating the audio pipeline into a dedicated thread. Another challenge was discovering that the eBay API was decommissioned in February 2025, requiring a switch to SerpApi for real sold listings.
Accomplishments that we're proud of
Built a working invisible AI agent that operates in real time with no screen interaction. The Live API voice mode feels like a knowledgeable friend whispering in your ear.
What we learned
Focused single-purpose agents outperform monolithic ones. Gemini Live API shifts interaction from turn-based commands to natural conversation. Audio pipelines on Windows require careful thread isolation when combining asyncio with UI frameworks.
What's next for AuctionEye
A mobile version (phone camera + earphone), support for additional marketplaces beyond eBay, and item history across sessions to track price trends at the same vendor.
Log in or sign up for Devpost to join the conversation.