Front Door Intelligence

Turn raw Ring doorbell events into one-sentence AI summaries delivered to your Fire TV without interrupting viewing.

Comment

💡 Inspiration

Smart video doorbells are supposed to give homeowners peace of mind, but in practice, they create severe notification fatigue. Every time someone approaches your front door, your phone buzzes with a generic alert: "Motion detected at Front Door".

To know what happened, you have to stop what you're doing, unlock your phone, open the Ring app, and wait 10 seconds for video buffering—only to discover a neighborhood cat or a falling leaf. For families watching a movie, remote workers in deep focus, or caregivers attending to loved ones, this constant interruption creates unnecessary friction.

We asked: What if the front door simply told you what happened in plain English, on the largest screen in the house, without stopping your show?

🚪 What It Does

Front Door Intelligence is an end-to-end event-driven pipeline that transforms raw camera events into glanceable television intelligence:

  1. Sub-5-Second Webhook Ingress: Receives Ring doorbell presses and motion triggers, verifying HMAC-SHA256 signatures over raw request bytes to block unauthorized payloads.
  2. One-Sentence AI Summaries: Retrieves camera snapshots and uses Amazon Bedrock (Claude 3 Haiku / Amazon Nova) to generate a single, plain-English descriptive sentence (e.g., "A delivery courier places a medium package by the planter box and walks away").
  3. Non-Intrusive Fire TV Overlay: Pushes the summary and thumbnail in real-time over WebSockets to a transparent Fire TV overlay. The overlay displays for exactly 15 seconds before auto-dismissing, or dismisses immediately via the Fire TV remote's D-pad.
  4. Daily Digest & Event Query: A web dashboard provides homeowners with a timeline of today's door activity, capped by an automated nightly 9 PM EventBridge summary that synthesizes the entire day's events into a cohesive recap.

🎯 Why It Wins: Creative Personas Beyond Security

The Ring hackathon rubric explicitly rewards Creative use cases over basic motion detection:

  • Package & Delivery Management: Know whether a package was placed out of sight or handed to a resident.
  • Elder Care & Family Awareness: Ambiently confirm that an elderly relative stepped out into the garden or that children arrived home from school without opening an app.
  • Accessibility: Enables deaf and hard-of-hearing homeowners to receive rich door alerts directly on the TV screen without relying on auditory chimes.

🛠️ How We Built It

  • AWS Serverless Architecture (SAM):
    • Amazon API Gateway: HTTP API for webhook ingress and query endpoints; WebSocket API for real-time Fire TV overlay pushes.
    • AWS Lambda (TypeScript / ES2022): Modular handlers for ingress, snapshot fetching, Bedrock inference, WebSocket delivery, and scheduled daily summaries.
    • Amazon SQS: Asynchronous queues decoupling webhook receipt from media fetching, guaranteeing sub-5-second ingress responses.
    • Amazon DynamoDB: Single-table design with date partitions for sub-millisecond event lookups, idempotency caching, and connection registry.
    • Amazon S3: Encrypted storage for temporary snapshot frames.
    • Amazon Bedrock: Claude 3 Haiku and Amazon Nova multimodal models for sub-second image-to-text inference.
  • Frontend Clients (Zero Dependencies):
    • Fire TV Overlay Client: Written in vanilla TypeScript with zero external frameworks to ensure peak 60fps performance inside Vega OS's transparent @amazon-devices/webview surface.
    • Homeowner Web Dashboard: Plain TypeScript client with live timeline and daily summary cards.

🧪 Engineering Rigor & Reliability

  • 483 Automated Unit Tests: 100% passing test suite across handlers, domain libraries, and frontends using Vitest.
  • 99.19% Code Coverage: Mechanical verification ensuring all edge cases and error handling branches are exercised.
  • Zero External Dependencies in Bundles: Standalone distribution verified via esbuild and custom bundle validator (npm run build:verify).
  • Open Source Contribution: Standalone zero-dependency companion package ring-webhook-verifier published to the developer ecosystem.

Built With

Share this project:

Updates

Submission history