Inspiration

Millions of real-world businesses—from local restaurants, boutique hotels, and wellness spas to neighborhood supermarkets, auto repair shops, and creators—remain locked out of the digital and agentic economy. Most have zero structured online presence, rely on fragmented pen-and-paper or disjointed point solutions, and struggle to manage payments across multiple rails (cards, bank transfers, crypto stablecoins, or in-house customer credit).

When the AI revolution arrived, these businesses were left behind: AI browsing agents and voice assistants cannot navigate brittle PDFs, messy HTML menus, or multi-step checkout modals without breaking.

We asked: What if any business could register on a single platform in 60 seconds and instantly go from having zero digital presence to a complete commerce operating layer, dual-layer AI copilots for both customers and staff, and immediate out-of-the-box readiness for the autonomous agentic future?

That vision is WETAEGO (The Commerce & Service Operating System for Modern Brands, their Human Customers, and the AI Agents who serve them).


What it does

By simply registering on WETAEGO, a business instantly receives a complete 4-tier commerce and operational ecosystem:

  1. Instant Digital Storefront & Multi-Rail Commerce Engine:

    • Deploys responsive, high-performance storefronts supporting arbitrary commercial models: physical retail, timed service bookings, restaurant dine-in/takeout, apartment reservations, and dynamic B2B rate cards.
    • Universal Omnichannel Payments: Handles Credit/Debit cards, instant Bank Transfers, Crypto/Stablecoins (USDC, USDT, SOL via Bachs), and in-house customer IOU / BNPL credit ledgers, backed by an in-person counter POS.
  2. Frontline Customer-Facing AI Concierge:

    • Every storefront is equipped with a 24/7 AI Concierge that acts as the primary point of contact. Grounded with strict zero-hallucination guardrails, it answers queries, filters allergies, recommends pairings, customizes orders, and seamlessly escalates to human staff via live alerts when needed.
  3. Tego Merchant AI Co-Pilot (Multimodal Voice & Vision):

    • On the business side, merchants get Tego: a hands-free, multimodal operational copilot. Merchants can talk naturally to Tego (low-latency bidirectional voice) or point their device camera (Tego Vision) at physical menus, handwritten receipts, stockroom inventory, or kitchen dishes to automatically ingest items, update stock, or trigger dashboard actions.
  4. Instant WebMCP Agent-Readiness:

    • The storefront automatically registers an 8-tool standardized W3C WebMCP suite onto document.modelContext. When browsing agents (like ChatGPT Desktop or Google Chrome with WebMCP) visit the merchant's URL, they can search products, compose complex modifiers, manage carts, and co-browse with the customer in real time—with an architectural Human-in-the-Loop Safe Payment Gate ensuring financial safety.
  5. Full Business Operating Layer:

    • Includes a real-time order dispatch & Kitchen Display System (KDS), driverless raw ESC/POS thermal receipt printing over WebUSB/WebSerial/Bluetooth, staff push-to-talk intercom radio, dynamic QR/NFC generator, inventory BOM tracking, and multi-branch franchise replication in under a second.

How we built it

  • Frontend & Architecture: Next.js (App Router, Server Actions, Edge Proxy), React 19, TypeScript, Tailwind CSS, and Framer Motion.
  • Client WebMCP Layer: Standardized W3C document.modelContext.registerTool() registry dynamically exposing canonical tools (search_catalog, get_item_details, create_cart, add_to_cart, get_cart, update_cart, initiate_checkout, submit_order, request_staff).
  • Reactive State Bridge: Bi-directional synchronization between WebMCP tool executions, Zustand stores, IndexedDB persistence, and real-time UI notifications (animated toasts, pulsing cart drawers).
  • Backend & Real-Time: Supabase (PostgreSQL, Row-Level Security, Realtime WebSockets) and Upstash Redis for edge rate limiting.
  • Multimodal AI: Google Gemini Live API (16kHz PCM audio streaming, 1 FPS continuous vision ingestion) and Vercel AI SDK.
  • Server MCP Suite: Enterprise /api/mcp endpoint for remote agent management across multi-location fleets.

Challenges we ran into

  1. Polymorphic Modifier Matrices for AI: Real-world items (steaks with doneness, laptops with RAM/storage tiers, spa treatments with durations) have complex dependency trees. We engineered dynamic JSON schema generators that allow agents to resolve multi-dimensional configuration axes deterministically.
  2. Real-Time Client State Synchronization: Ensuring in-browser agent tool calls immediately reflected in the human user's viewport without race conditions or page reloads required building a custom reactive bridge between document.modelContext and our Zustand/IndexedDB stores.
  3. Hardware Without Daemons: Crafting direct binary ESC/POS command streams for thermal printers over WebUSB and WebSerial without relying on background desktop print spools.

Accomplishments that we're proud of

  • Zero-Friction Transformation: Any merchant can create an account and immediately get a storefront, multi-rail payments, dual AI assistants, and WebMCP agent readiness with zero manual API configuration.
  • Human-in-the-Loop Safe Payment Gate: Designed an architecture where AI handles heavy constraint filtering and cart composition, but payment authorization remains strictly in the hands of the human customer via biometric/one-tap confirmation.
  • Complete Test Coverage: 100% pass rate across Vitest WebMCP integration suites and end-to-end Playwright tests.

What we learned

  • WebMCP transforms web browsing from passive visual scraping into deterministic, structured collaboration between humans and AI.
  • Client-side in-session tool execution eliminates latency and keeps sensitive session state private within the user's browser.

What's next for WETAEGO

  • Providing Businesses across scale with instant online presesnce, AI-capabilities and webMCP readiness, empowering them with tools to compete and succeed in this Digital/AI/Agentic era.
  • Expanding our 14 Open Discovery Protocols (RFC 9727, x402 machine payments, DNS-AID) to support fully autonomous machine-to-machine supply chain ordering.
  • Releasing ready-to-use POS hardware kits for self-service kiosks running WETAEGO WebMCP.

Built With

  • framer-motion
  • gemini-live-api
  • google-gemini-api
  • indexeddb
  • model-context-protocol
  • next.js
  • paystack
  • playwright
  • postgresql
  • pwa
  • react
  • sentry
  • supabase
  • tailwind-css
  • typescript
  • upstash-redis
  • vercel-ai-sdk
  • vitest
  • webmcp
  • websockets
  • webusb
  • x402-protocol
  • zod
  • zustand
Share this project:

Updates

Submission history