Sylex Assistant Pro

A production‑ready multi‑agent voice assistant with memory, automation, navigation, and real‑time intelligence.

Comment

Inspiration

Modern AI assistants are fragmented. One works well in the car, another for productivity, another for kids — and none share memory or context. People are forced to repeat themselves, switch tools constantly, and lose continuity throughout the day.

I wanted to build one AI agent that adapts to every real‑life context — driving, personal life, business tasks, and family — while maintaining consistent memory, safety, and behavior. That idea became Sylex Assistant Pro.

What it does

Sylex Assistant Pro is a multilingual, voice‑first AI assistant for iOS and Android that adapts to four real‑world modes:

  • Car Mode — short, safe, low‑distraction responses
  • Personal Mode — reminders, routines, daily tasks
  • Business Mode — emails, summaries, planning
  • Kids Mode — safe, filtered, age‑appropriate answers

Key capabilities:

  • Real‑time navigation context (ETA, traffic, turn‑by‑turn)
  • Long‑term memory for preferences, routines, and history
  • Document Q&A (PDF/TXT)
  • Natural‑language automation
  • Streaming responses for ultra‑low latency
  • Cross‑platform subscriptions (iOS + Android) ## How we built it Sylex Assistant Pro uses a multi‑agent architecture:
  • Voice Agent — speech recognition + TTS
  • Context Agent — mode switching + safety rules
  • Memory Agent — long‑term + session memory
  • Navigation Agent — traffic, ETA, routing
  • Knowledge Agent — grounded search + structured reasoning

Pipeline

  1. User speaks via push‑to‑talk
  2. Speech is transcribed in real time
  3. Backend routes the request to the correct agent
  4. A two‑phase grounding pipeline retrieves fresh information
  5. The response is generated, validated, and streamed
  6. On‑device TTS delivers the final output instantly

Tech stack

  • React Native + TypeScript (mobile)
  • Node.js + Express (backend)
  • Cloud Run (deployment)
  • Firestore (memory, routines, settings)
  • Google Maps Routes API (navigation)
  • App Store + Google Play Billing (subscriptions)
  • SSE streaming for low latency ## Challenges we ran into
  • Designing a memory system that feels natural and persistent
  • Ensuring car‑safe responses with strict brevity and safety rules
  • Coordinating multiple agents without conflict
  • Handling ambiguous voice commands in real time
  • Maintaining low latency across mobile + cloud
  • Managing audio session stability on iOS
  • Building a two‑phase grounding pipeline for reliable factual answers ## Accomplishments that we're proud of
  • A production‑ready AI assistant available on both App Store and Google Play
  • A fully working multi‑agent architecture with real‑world use cases
  • A car‑safe AI mode with strict safety constraints
  • A long‑term memory system that persists across sessions
  • A navigation‑aware AI that understands traffic, ETA, and routing
  • A freemium subscription model with cross‑platform entitlement validation
  • A real, usable product, not just a prototype ## What we learned
  • Grounding and structured reasoning must be separated for reliability
  • Memory transforms an assistant from “chatbot” to “companion”
  • Car UX requires strict output constraints and safety filters
  • Multi‑agent systems outperform single‑prompt architectures
  • Real‑time voice UX demands extremely low latency
  • Event‑driven audio sequencing is more stable than timer‑based chaining ## What's next for Sylex Assistant Pro
  • Wake‑word engine (on‑device)
  • Agent marketplace for custom skills
  • Cross‑device memory sync (car, phone, tablet)
  • Offline mode for essential tasks
  • Enterprise workflows (CRM, scheduling, automation)
  • Multi‑agent collaboration for complex tasks
  • Integration with Alibaba Cloud Qwen models for multilingual performance ##Additional Information The app is fully production‑ready and publicly available on both major app stores:
  • iOS (App Store): https://apps.apple.com/app/silverleaf-assistant-pro/id6759394918
  • Android (Google Play): https://play.google.com/store/apps/details?id=studio.silverleaf.carassistantpro&gl=de

Built With

Share this project:

Updates