Event vocabulary (14 types, 4 routing tiers)
| User action | Event | Route | Result |
|---|---|---|---|
⌘⇧Space |
HOTKEY |
BIG_LLM | Vision + mood reply + animation |
⌘⌃F |
MEAL_LOG |
BIG_LLM | Nutrition extraction + photo upload + meals row |
⌘⌃R |
MEDICAL_REPORT_LOG |
BIG_LLM | OCR + meds/conditions extracted, auto-merged into profile |
⌘⌃D |
DOCTOR_SUMMARY |
BIG_LLM | 1-page markdown summary → /tmp + clipboard |
| "Hey Shelly, …" | SPEECH → wake |
BIG_LLM | Conversational reply (60s follow-up window) |
| "chest pain" | SPEECH → EMERGENCY |
BIG_LLM | Urgent reply + severity='urgent' observation, bypasses budget |
| Ambient talk | SPEECH |
LOG | Fed into passive tracker |
| 60s speech + 30s silence | CONVERSATION_ENDED |
BIG_LLM | Auto-summary + durable memory extraction |
| Med schedule hits | MED_REMINDER |
CHEAP_LLM | Profile-driven medication nudge |
| First activity ≥6am | MORNING |
CHEAP_LLM | Good-morning line |
| 9pm first tick | DAILY_SUMMARY |
BIG_LLM | Day rollup |
| Random 30–90m active | CHECK_IN |
CHEAP_LLM | Proactive warm nudge, 5/day cap |
| Idle >10m → active | ACTIVE (with was_idle_seconds) |
CHEAP_LLM | Welcome back |
| >45m social media | APP_DURATION |
CHEAP_LLM | Doomscroll nudge |
| Night idle ≥4h | (observation) | — | Logged as inferred sleep |
Rate limit: OMI_LLM_BUDGET_PER_HOUR (default 10). Emergencies bypass it.
Log in or sign up for Devpost to join the conversation.