Savant Synesthetic Agent

Project Title: Savant Synesthetic Agent

Category: Live Agents (Real-time interaction).

Project Summary (The Problem & Solution) The Savant Synesthetic Agent is a personal talent curator designed for neurodivergent adults (ASD/ADHD) who discover their exceptional capabilities late in life. Traditional systems often fail to recognize these unique cognitive profiles, labeling them as "late to the game." This agent acts as the mentor the system never provided, helping users map and develop their extraordinary talents through a deep, non-linear, and multimodal approach.
Core Features & Multimodal Experience Bayesian Reasoning: The agent doesn't just respond; it updates its internal understanding of the user’s cognitive patterns with every interaction, evolving alongside them.

Synesthetic Graphing: Leveraging Gemini’s multimodal output, the agent helps the user visualize their synesthetic experiences by generating images that translate sensory perceptions into visual data.

Deep Inquiry: It moves beyond generic chat to ask profound, challenging questions that stimulate advanced pattern recognition.

Technologies Used Google Gemini 2.0 Flash (Live API): To ensure ultra-low latency and natural voice interaction, allowing the user to interrupt and flow organically.

Google Cloud Hosting: The backend is robustly hosted on Google Cloud, ensuring high availability and integration with GenAI services.

Google GenAI SDK: Built natively using the official Python SDK to manage real-time multimodal streams.

Findings & Learnings

During the development, I discovered that the Multimodal Live API is a game-changer for accessibility. It allows users with ADHD and sensory processing differences to communicate without the "text-box" barrier, making the experience inclusive and deeply personal. I learned how to ground the model using Bayesian-inspired instructions to avoid hallucinations and ensure professional-level guidance.