Bridging Digital Identity to the Physical World

Inspiration

We've solved identity online—profiles, bios, social graphs, shared interests. But the moment we step into the physical world, context disappears. Access becomes awkward. Discovery feels invasive.

The problem isn't information. It's how and when it appears.

We built a system that brings digital context into physical spaces—recognizing who someone is and surfacing relevant information at the right moment.


The Pipeline

Our system chains multiple APIs to go from camera feed to identified person:

  1. Overshoot AI — Detection

    • RealtimeVision SDK analyzes camera feed
    • Detects when someone is intentionally engaging (not just passing by)
    • Checks: centered in frame, facing camera, stationary
    • Requires 3 consecutive confirmations to reduce false positives
  2. MediaPipe + OpenCV — Feature Extraction

    • Extracts facial landmarks from captured image
    • Converts face into a numerical feature vector
  3. Wood Wide AI — Embedding & Matching

    • POST /api/models/embedding/train — Trains embedding model on face database, returns model_id
    • GET /api/models/{model_id} — Poll until status is COMPLETE
    • POST /api/models/embedding/{model_id}/infer — Generates embedding vectors
    • Compares embeddings using Euclidean distance to find the closest match
  4. Output — ChatGPT API

    • Returns identified person's name for next steps (display greeting, log access, etc.)

Tech Stack

  • Frontend: React + Overshoot SDK
  • Feature Extraction: MediaPipe + OpenCV
  • Embeddings: Wood Wide AI
  • Backend: Python Flask

Challenges

  • False positives → Solved with 3-consecutive-detection requirement
  • API integration → Implemented Wood Wide AI's train → poll → infer workflow
  • Real-time performance → Balanced accuracy vs. speed with threshold tuning
  • Pivots → No API for some companies, network complications, and feasibility

What We Learned

Embedded spaces turn identity into geometry—making "who is this?" a simple distance calculation.


Built at NexHacks 2026

Built With

Share this project:

Updates