Inspiration The 3 Big Flaws of Traditional Voice Skills
Current smart home voice skills are broken in three frustrating ways: • Sluggish Latency: A 5-device "Goodnight" routine chains multiple cloud skills sequentially, forcing users to wait through 3 to 4 seconds of awkward silence. • Dangerous "False Success": If your back deadbolt jams during bedtime, traditional skills still say "All set!", leaving your home unlocked and unprotected. • Brittle Keyword Matching: Say "Did anyone deliver?" instead of the exact robotic phrase, and traditional assistants give you the thermostat temperature instead of camera footage.
👉 Our Solution: Alexa+ LifeSync MCP — an autonomous ambient home agent built on the open Model Context Protocol (MCP) and AWS Bedrock, bringing atomic speed, distributed rollback safety, and zero-trust security to Alexa+.
What it does: Alexa+ Supercharged by MCP
• Atomic Routines (85.3% Faster): Controls deadbolts, alarms, thermostat, and lighting in 1 single MCP transaction (~520 ms) instead of 5 separate cloud roundtrips (3,550 ms). • Compensating Saga Rollback: If a door lock jams, LifeSync halts execution and automatically rolls back perimeter changes to a safe warning state (no more false security!). • Constant-Time PIN Guardrails: Exterior unlocks require voice PIN authentication using hmac.compare_digest with a 5-minute lockout after 3 fails. Raw PINs are masked ([MASKED]) so LLMs never see or leak them. • SHA-256 Tamper-Proof Audit Trail: Every single action is written to a cryptographically chained audit log that verifies zero tampering via verify_chain(). • Radical API Honesty: Powered by a genuinely live HTTP feed to the Open-Meteo REST API for satellite weather and real RFC 5545 iCalendar sync (no mocked data). • Proactive Ambient Alerts: Unprompted interventions for Ring porch deliveries, low wearable recovery scores, and hackathon deadline focus modes. • Official Alexa ASK Webhook: Includes a production-ready /api/alexa/skill endpoint ready for the Alexa Developer Console and real Echo devices.
How we built it
AI Reasoning: AWS Bedrock Converse API (anthropic.claude-3-5-sonnet) with dynamic tool declarations, speakable system prompts, and token-level cost tracking. • Protocol Bus: FastMCP exposing tools for Ring camera events, smart home routines, live weather, and security logs. • Reliability Engine: A custom Python Saga Coordinator with forward steps and compensating rollback actions. • Hardened Router: Tested and validated against a 27-query paraphrase matrix so short, sloppy phrases ("any packages today?", "secure the house") route with 100% precision. • Live Observability UI: High-density developer dashboard featuring live latency waterfalls, collapsible JSON inspectors, and failure-injection toggles.
Challenges we ran into
• Keeping PINs Safe from LLMs: Prevented Bedrock from hallucinating or speaking sensitive PINs by intercepting authentication in a pre-inference guardrail. • Bridging ASK and MCP: Mapped Alexa's synchronous IntentRequest lifecycle to asynchronous agent tool calling while maintaining pending_query session state. • Zero Fake Numbers: Rejected fake "10ms cloud latency" hacks. We clearly separate live AWS Bedrock timings from modeled offline simulator assumptions.
Accomplishments that we're proud of
• 100% Test Pass Rate: All 8 enterprise test cases and 27 natural paraphrases pass with zero errors. • Real Failure Engineering: Interactive demo toggle simulating hardware deadbolt jams with live Saga rollback. • 10% Bonus Friction Log: Comprehensive documentation of real developer friction with Alexa voice PIN challenges and ASK SDK async constraints.
What we learned
• Tools Beat Skills: MCP's tool-calling architecture is far more composable, reliable, and scalable than isolated voice skills. • IoT Needs Sagas: Physical hardware fails. Distributed system patterns (like Sagas) are mandatory for real-world smart home safety.
What's next for Alexa+ LifeSync MCP: Atomic Ambient Agent
• Physical Matter 1.3 Thread Border Router: Moving from modular adapters to real Matter hardware over Thread. • Edge SLM Fallback: Running local small language models on-device for zero-latency offline routines. • Ambient Eldercare Radar: Integrating non-invasive RF presence sensing for senior wellness checks.
Built With
- alexa-skills-kit
- ask-sdk
- aws-bedrock
- boto3
- claude-3.5-sonnet
- css3
- fastapi
- fastmcp
- github
- hmac
- html5
- icalendar
- javascript
- matter
- model-context-protocol
- open-meteo-api
- pydantic
- python
- rest-api
- rfc-5545
- sha-256
- uvicorn
- zigbee
Log in or sign up for Devpost to join the conversation.