Inspiration The 3 Big Flaws of Traditional Voice Skills

Current smart home voice skills are broken in three frustrating ways: • Sluggish Latency: A 5-device "Goodnight" routine chains multiple cloud skills sequentially, forcing users to wait through 3 to 4 seconds of awkward silence. • Dangerous "False Success": If your back deadbolt jams during bedtime, traditional skills still say "All set!", leaving your home unlocked and unprotected. • Brittle Keyword Matching: Say "Did anyone deliver?" instead of the exact robotic phrase, and traditional assistants give you the thermostat temperature instead of camera footage.

👉 Our Solution: Alexa+ LifeSync MCP — an autonomous ambient home agent built on the open Model Context Protocol (MCP) and AWS Bedrock, bringing atomic speed, distributed rollback safety, and zero-trust security to Alexa+.

What it does: Alexa+ Supercharged by MCP

• Atomic Routines (85.3% Faster): Controls deadbolts, alarms, thermostat, and lighting in 1 single MCP transaction (~520 ms) instead of 5 separate cloud roundtrips (3,550 ms). • Compensating Saga Rollback: If a door lock jams, LifeSync halts execution and automatically rolls back perimeter changes to a safe warning state (no more false security!). • Constant-Time PIN Guardrails: Exterior unlocks require voice PIN authentication using hmac.compare_digest with a 5-minute lockout after 3 fails. Raw PINs are masked ([MASKED]) so LLMs never see or leak them. • SHA-256 Tamper-Proof Audit Trail: Every single action is written to a cryptographically chained audit log that verifies zero tampering via verify_chain(). • Radical API Honesty: Powered by a genuinely live HTTP feed to the Open-Meteo REST API for satellite weather and real RFC 5545 iCalendar sync (no mocked data). • Proactive Ambient Alerts: Unprompted interventions for Ring porch deliveries, low wearable recovery scores, and hackathon deadline focus modes. • Official Alexa ASK Webhook: Includes a production-ready /api/alexa/skill endpoint ready for the Alexa Developer Console and real Echo devices.

How we built it

AI Reasoning: AWS Bedrock Converse API (anthropic.claude-3-5-sonnet) with dynamic tool declarations, speakable system prompts, and token-level cost tracking. • Protocol Bus: FastMCP exposing tools for Ring camera events, smart home routines, live weather, and security logs. • Reliability Engine: A custom Python Saga Coordinator with forward steps and compensating rollback actions. • Hardened Router: Tested and validated against a 27-query paraphrase matrix so short, sloppy phrases ("any packages today?", "secure the house") route with 100% precision. • Live Observability UI: High-density developer dashboard featuring live latency waterfalls, collapsible JSON inspectors, and failure-injection toggles.

Challenges we ran into

• Keeping PINs Safe from LLMs: Prevented Bedrock from hallucinating or speaking sensitive PINs by intercepting authentication in a pre-inference guardrail. • Bridging ASK and MCP: Mapped Alexa's synchronous IntentRequest lifecycle to asynchronous agent tool calling while maintaining pending_query session state. • Zero Fake Numbers: Rejected fake "10ms cloud latency" hacks. We clearly separate live AWS Bedrock timings from modeled offline simulator assumptions.

Accomplishments that we're proud of

• 100% Test Pass Rate: All 8 enterprise test cases and 27 natural paraphrases pass with zero errors. • Real Failure Engineering: Interactive demo toggle simulating hardware deadbolt jams with live Saga rollback. • 10% Bonus Friction Log: Comprehensive documentation of real developer friction with Alexa voice PIN challenges and ASK SDK async constraints.

What we learned

• Tools Beat Skills: MCP's tool-calling architecture is far more composable, reliable, and scalable than isolated voice skills. • IoT Needs Sagas: Physical hardware fails. Distributed system patterns (like Sagas) are mandatory for real-world smart home safety.

What's next for Alexa+ LifeSync MCP: Atomic Ambient Agent

• Physical Matter 1.3 Thread Border Router: Moving from modular adapters to real Matter hardware over Thread. • Edge SLM Fallback: Running local small language models on-device for zero-latency offline routines. • Ambient Eldercare Radar: Integrating non-invasive RF presence sensing for senior wellness checks.

Built With

  • alexa-skills-kit
  • ask-sdk
  • aws-bedrock
  • boto3
  • claude-3.5-sonnet
  • css3
  • fastapi
  • fastmcp
  • github
  • hmac
  • html5
  • icalendar
  • javascript
  • matter
  • model-context-protocol
  • open-meteo-api
  • pydantic
  • python
  • rest-api
  • rfc-5545
  • sha-256
  • uvicorn
  • zigbee
Share this project:

Updates

Submission history