vision stream: The Multi-Agent Reality Auditor

A PWA that turns smartphones into real-time asset auditors. Using a multi-agent Gemini 3 three AI agents debate the value of physical objects live to unlock credit for the unbanked.

Comment

💡 Inspiration

In emerging markets like Nigeria, millions of merchants possess valuable physical inventory but lack the documented credit history to access capital. Banks can't "see" what they own, so they can't lend. We realized that if we could digitize trust—by instantly and accurately auditing physical assets using AI—we could unlock billions in liquidity for the unbanked.

🤖 What it does

MarketForce is a Progressive Web App (PWA) that transforms any smartphone into an enterprise-grade appraisal tool. Instead of a single AI "guessing" a price, we engineered a "Hive Mind" Consensus Engine.

When a user points their camera at an object, the system spawns three parallel Gemini 3 agents that debate the value live:

  • 🔴 The Bear Agent: Scans for damage, wear, and depreciation (Pessimistic).
  • 🟢 The Bull Agent: Identifies brand value, vintage appeal, and utility (Optimistic).
  • 🟡 The Judge Agent: Synthesizes the debate into a final, volatility-adjusted market value.

⚙️ How we built it

We prioritized "Edge-Native" architecture to ensure it works in the field:

  • AI Engine: Google Gemini 1.5 Flash (via Gemini 3 API) for sub-200ms multimodal video processing.
  • Reasoning: Implemented "Thinking Levels" and "Thought Signatures" to ensure the agents maintain consistent personas during the debate.
  • Grounding: Integrated Firecrawl to perform live web searches for real-time market pricing (eBay/Amazon) to ground the AI's hallucinations.
  • Frontend: Built with React/Vite/Lovable as an installable PWA.
  • Real-time: Supabase Realtime for the "Audit Stream," allowing remote loan officers to watch scans live.

🧠 Challenges we ran into

The biggest hurdle was Race Conditions on the Edge. Because the video feed sends frames every 500ms, the AI responses would overlap, causing the "Bear" to talk about the previous object while the "Bull" talked about the new one.

  • Solution: We implemented an AbortController logic that cancels stale reasoning streams the moment the camera detects significant movement.

🏅 Accomplishments that we're proud of

  • Achieving a "cinematic" boot sequence that feels like a sci-fi movie but runs in the browser.
  • Successfully coordinating three parallel AI agents to debate in real-time without crashing the mobile browser.
  • Building a tool that actually works on a $100 Android phone in Lagos, not just a MacBook Pro.

🚀 What's next for MarketForce

We plan to partner with micro-finance banks to pilot this as a "Self-Service Audit" tool. We are also refining the "Judge" agent to generate PDF certificates that can be used as legal collateral.

Built With

Share this project:

Updates