SDOH Chat

A Gemini-powered AI agent network that reconnects ostracized individuals to community assets. We transform ghosts into pillars of society through voice-first, low-bandwidth health and social support.

Comment

🛡️ Project Story: SDOH Chat (The Ghost-to-Pillar Project) 🇷🇼 Inspiration: The Void In the heart of healthcare, we often fix the body but forget the soul. We were inspired by a haunting reality: Ostracization. When a patient loses their "Inner Circle"—their family, their protectors—they become a "ghost" in their own community.

We realized that for a pregnant woman or an elderly man, medicine isn't enough. They need to be seen as assets, not burdens. We built this to turn the "Why" of survival into a biological force, using AI to rebuild the tether between the isolated and the tribe.

⚡ What it does SDOH Chat is a voice-first AI gateway that addresses the Social Determinants of Health (SDOH).

It uses Gemini AI to listen to the vulnerable, extracting emotional context and health needs.

It transforms clinical needs into "Community Quests," gamifying the act of being useful.

It tracks Integrity XP, showing users their progress as they evolve from a "ghost" back into a community "pillar."

🛠️ How we built it We engineered a resilient, "always-on" architecture designed for the African tech landscape:

The Brain: Gemini 1.5 Flash via Google Cloud Vertex AI for rapid, empathetic reasoning.

The Ears: Local Whisper Mini for private, offline speech-to-text.

The Voice: ElevenLabs hybrid engine that falls back to local synthesis if the internet drops.

The Nervous System: Confluent (Kafka) streams real-time community events to prevent data silos.

The Shield: Datadog for end-to-end observability of our AI agents.

🚧 Challenges we ran into Building for low-bandwidth environments is a battle. We faced "The Silence"—moments when the cloud was unreachable. We had to build a complex Resilience Layer that switches to a local Gemma 2B (Ollama) instance seamlessly. Ensuring the AI's "empathy" didn't feel robotic while maintaining high speed was a constant tuning process.

🏆 Accomplishments that we're proud of Zero-Downtime Empathy: Our hybrid cloud/local fallback ensures that the "voice" of the community never goes silent, even in remote areas.

Asset Recognition: Successfully using Gemini to identify a user's hidden strengths, turning a "patient profile" into a "leadership profile."

Multimodal Integration: Bridging the gap between Radiology (PACS/RIS) and social welfare.

📚 What we learned We learned that Technology is not a replacement for the tribe; it is a tool to rebuild it. We discovered that Gemini’s ability to process "soft data" (emotions, social ties) is just as powerful as its ability to process "hard data" (diagnostics).

🚀 What's next for SDOH Chat Kinyarwanda Localization: Bringing full native language support for our brothers and sisters in Rwanda.

The "Asset" Dashboard: A view for community leaders to see the "Human Assets" (like pregnant women and elders) available to mentor and lead local initiatives.

On-the-Edge Deployment: Further optimizing the Forge to run on even lower-spec hardware.

"When you are a pillar, you cannot afford to fall. That is when you become immortal."

Share this project:

Updates