Inspiration

In a world dominated by image-first dating apps, we noticed something missing—genuine connection. Most dating platforms encourage people to judge based on looks, filters, and curated profiles. But what if dating felt more human, less performative, and more playful? That’s how SitWithMe was born: a voice-first, avatar-powered dating experience that brings blind dating to life in a safe, low-pressure way—no video, just vibes.

What it does

SitWithMe lets users go on 5-minute blind dates using expressive 3D avatars and real-time audio. Avatars mimic facial expressions using face tracking, while a countdown timer keeps things light and spontaneous. No profile scrolling, no awkward bios—just jump in, talk, laugh, and see where it goes.

How we built it

  • Avatar Streaming: We used PeerJS for peer-to-peer transmission of lightweight avatar movement data (~1.5 KBps).
  • Facial Tracking: Built a browser-based tracker to animate avatars using real-time camera input without sending video over the network.
  • Frontend: Developed using web technologies (React, HTML Canvas) to render avatars and UI components like timers.
  • Audio Communication: Implemented WebRTC-based voice streaming to allow high-quality low-latency audio between users.

Challenges we ran into

  • Ensuring low-latency sync between audio and avatar movement.
  • Handling facial tracking efficiently on lower-end devices.
  • Creating a fun, inviting avatar experience that’s expressive yet lightweight.
  • Managing NAT traversal and fallback in PeerJS connections.

Accomplishments that we're proud of

  • Created a working avatar + voice dating prototype with under 2 KBps bandwidth.
  • Developed a unique dating format that feels personal and fresh.
  • Built an expressive, animated avatar pipeline in the browser.
  • Got great early feedback: people say it feels like “metaverse Clubhouse for dating.”

What we learned

  • People are open to dating formats beyond video and photos.
  • Lightweight, privacy-first communication is both technically possible and emotionally impactful.
  • It’s crucial to build not just tech, but also trust and emotional resonance.

What's next for SitWithMe

  • Add avatar customization to increase emotional expression and personality.
  • Implement voice moderation and safety tools (real-time abuse detection).
  • Launch a private beta with curated user groups.
  • Expand into real-time “dating events” and “interest-based rooms.”
  • Eventually monetize through avatar upgrades and premium matching features.
Share this project:

Updates