Inspiration

NEXUS uses Gemini Live API multimodal capabilities to visually analyze smart contract UIs, token dashboards, and DeFi interfaces for ERC-3643/ERC-8004 compliance violations in real-time.

How it works

  1. User provides a URL or screenshot of any token dashboard/smart contract UI
  2. NEXUS streams the visual feed to Gemini Live API for real-time multimodal analysis
  3. Gemini Live identifies UI elements that indicate compliance risks: missing KYC gates, incorrect transfer restriction displays, unlocked admin functions
  4. NEXUS cross-references against ERC-3643/ERC-8004 rule set and generates a structured compliance report
  5. Report includes: violation type, severity (Critical/High/Medium/Low), UI screenshot annotation, and remediation guidance
  6. All assessments are attested on-chain via Hedera Consensus Service (HCS-10)

What I built

A real-time AI compliance auditor for token UIs. Drag in a URL or screenshot — get back a full ERC-3643 compliance report with on-chain attestation.

Challenges

Streaming visual context to Gemini Live API in real time while maintaining low-latency response for UI auditing. Mapping visual UI elements to specific ERC-3643 rule violations required building a custom compliance ontology.

Accomplishments

Successfully integrated Gemini Live API multimodal streaming with Hedera HCS-10 attestation. Built a working compliance rule engine covering 23 ERC-3643 violation patterns.

What I learned

Gemini Live API's vision capabilities are remarkably good at identifying structural UI patterns. Combined with a compliance rule set, it becomes a powerful auditing tool.

What's next

Expand to ERC-20 and ERC-4626 compliance patterns. Add support for live smart contract function call analysis.

Built With

Share this project:

Updates