Inspiration
Always-on smart devices and wearable companions face two major dilemmas:
- Physical Blind Spots: Cameras miss forced entries or lock tampering that happen just outside their optical field of view.
- Context Collapse & Privacy Bleed: Continuous audio recording indiscriminately captures doctor calls, relationship discussions, and banking OTPs. When an AI agent is asked to draft a work email or summary, this sensitive personal context risks leaking directly into the prompt.
AegisEdge solves both problems on-device as an intelligent co-processor combining real-time multi-sensor threat intelligence with an air-gapped contextual privacy firewall.
What It Does
1. Physical Safety Guardian & Threat Engine
- Acoustic Sensor Fusion: Tracks environmental noise, lock tampering signatures, and glass impact spikes.
- Blind-Spot Tamper Detection: Cross-references sound with camera PIR states. A high acoustic spike paired with an idle camera automatically flags
OFF_CAMERA_TAMPER_DETECTED. - Sub-50ms Hardware Actuation: Fires automated lockdown commands to the device actuator in just 14.1 ms.
- Live Threat Engine HUD: Displays real-time ingestion parameters, correlation formulas, and latency receipts directly on screen.
2. Context-Aware Privacy Firewall
- Domain Boundary Classification: Evaluates continuous conversational audio slices into
WORK,PERSONAL, orCONFIDENTIALdomains. - Air-Gapped Context Sandboxing: When an agentic task (e.g., "Draft Work Email") is executed, non-work scopes are quarantined and scrubbed before the prompt window is constructed.
- Data Lineage Audit: Provides proof receipts showing authorized versus redacted context segments with zero data leakage.
How We Built It
- Architecture: Containerized Next.js 15 application running inside Docker for clean, reproducible evaluation.
- Edge Governance Engine: Custom TypeScript classifier enforcing strict domain segregation and token boundaries (
lib/privacyGuard.ts). - Hardware Interlock Controller: Resilient actuator controller with dual-mode dispatch and sandbox emulation (
lib/ringActions.ts). - Dashboard & Telemetry: Tailwind CSS dashboard paired with a live diagnostic HUD.
Challenges We Faced
- Asynchronous Sensor Synchronization: Aligning independent acoustic spikes with delayed device webhooks required building a sliding-window correlation buffer.
- Playground Sandbox Actuation: The developer playground lacks interactive write endpoints for locks or sirens, so we engineered a dual-mode hardware controller abstraction with automated sandbox fallback.
Accomplishments That We're Proud Of
- Achieved 14.1 ms actuator dispatch latency (well below the 50 ms target).
- Delivered an end-to-end demonstration proving 100% zero-leakage token scrubbing for agentic tasks.
- Maintained zero TypeScript errors and zero runtime warnings with strict static typing.
What We Learned
- Managing edge trade-offs between local sensor processing and cloud API latencies.
- Structuring zero-knowledge context firewalls for continuous wearable computing.
What's Next for AegisEdge
- Expanding local BLE mesh beaconing for offline perimeter lockdown during Wi-Fi outages.
- Integrating on-device quantized SLMs for local semantic categorization.
🏆 Bonus Criteria & Documentation
- 10% Bonus (Product Feedback): Detailed developer evaluation hurdles, reproduction steps, workarounds, and platform suggestions are documented in
docs/FRICTION_LOG.md. - Video Demo Guide: Script and execution checkpoints available in
docs/DEMO_SCRIPT.md.
Built With
- api
- docker
- next.js
- node.js
- react
- tailwind-css
- typescript
- webrtc
Log in or sign up for Devpost to join the conversation.