๐ BeeSense AI: Ambient Wearable Copilot & Second Brain
๐ก Inspiration
Wearables today are mostly passive recordersโthey track steps and heart rate or wait for you to tap a screen. We envisioned a truly ambient, intelligent companion that proactively assists you in daily life without requiring constant screen interaction. BeeSense AI transforms wearable hardware into an active, context-aware "Second Brain" and wellness guardian powered by Amazon Bedrock.
๐ What it Does
BeeSense AI continuously senses ambient context (conversations, environmental telemetry, and simulated biometrics) to deliver hands-free, proactive intelligence:
- ๐ง Ambient Memory & Instant Recall: Passively captures key context from meetings, conversations, and lectures. Users can ask: "What did Sarah mention about the project timeline?" and get instant, grounded answers.
- โก Proactive Context Nudges: Detects impending deadlines, action items, or critical information in real time and delivers gentle, audio-tactile prompts.
- โค๏ธ Smart Wellness & Stress Response: Correlates conversation sentiment with biometric spikes to detect stress situations and offer subtle calming micro-guidance.
- โ Interactive Wearable Simulator: A web-based hardware emulator that mirrors the Bee wearable experience directly in your browser.
๐ ๏ธ How We Built It
- Track: Bee (Wearable AI) + AWS Builder Challenge + Open Source Track
- AI Core: Amazon Bedrock (Anthropic Claude 3.5 Sonnet / AWS Titan) for natural language reasoning, context extraction, and episodic memory querying.
- Backend & Event Processing: Python FastAPI and AWS Lambda serverless architecture for handling low-latency telemetry and audio streams.
- Storage & Memory: Amazon DynamoDB for fast episodic recall and state vector storage.
- Frontend / Device Simulator: Modern React / Next.js & TailwindCSS simulator offering real-time audio waveform visualization, haptic feedback simulation, and live telemetry feeds.
๐ง Challenges We Faced
- Low-Latency Context Filtering: Ambient audio generates high volumes of data. We engineered a multi-stage filtering pipeline to only send semantically meaningful events to Amazon Bedrock, drastically optimizing token usage and latency.
- Simulating Wearable Hardware: Since the physical Bee hardware is emerging, building a realistic browser-based simulator with mock sensor telemetry and audio stream integration required thoughtful frontend engineering.
๐ Accomplishments We're Proud Of
- Implemented a sub-second contextual recall engine using Amazon Bedrock.
- Built a plug-and-play Open Source Wearable Simulator SDK that any developer can use to test wearable AI ideas.
- Created an intuitive, zero-touch user experience that respects privacy while maximizing ambient utility.
๐ What We Learned
- How to architect memory retrieval-augmented generation (RAG) for real-time ambient wearable streams.
- Best practices for designing prompt chains and guardrails using Amazon Bedrock for audio-first interfaces.
๐ฎ What's Next for BeeSense AI
- Direct integration with physical Bee hardware as developer kits expand.
- Edge AI inference for local keyword filtering before cloud sync.
- Multi-device sync with Alexa+ and smart home ecosystems for cross-device continuity.
Built With
- alexa
- amazon-bedrock
- aws-lambda
- claude-3-5-sonnet
- dynamodb
- fastapi
- generative-ai
- open-source
- python
- react
- rest-api
- tailwind-css
- typescript
- wearable-ai
Log in or sign up for Devpost to join the conversation.