Tongue Balance AI

Prevent burnout in 30 seconds. Tongue Balance AI uses Gemini 3's multimodal reasoning to translate ancient TCM tongue diagnostics into instant, proactive wellness plans.

Comment

Inspiration

In North America, wellness is a high-stakes priority, yet millions are trapped in a cycle of reactive care. We observed two massive "lifestyle bugs" affecting our community: Gut Health and Brain Fog. Research indicates that up to 74% of adults experience digestive discomfort monthly, and cognitive disability reports—often manifesting as serious difficulty concentrating or remembering—nearly doubled among young adults under 40 between 2013 and 2023, rising from 5.1% to 9.7%.

As co-founders deeply rooted in Traditional Chinese Medicine (TCM), we apply this ancestral knowledge to our daily lives to maintain harmony and vitality. From running a family tea house to practicing daily wellness rituals, we have experienced firsthand how TCM can prevent imbalance before it manifests. With the North American probiotics market alone projected to exceed $10.5 billion by 2026, it is clear that people are seeking proactive solutions. We built Tongue Balance AI to translate the body's internal "system logs"—the tongue—into actionable, modern intelligence for everyone.

What it does

Tongue Balance AI is a 24/7 proactive health sentinel that transforms your smartphone into a clinical-grade diagnostic partner.

  • Ancestral Reasoning Stream: Powered by Gemini 3 Flash, users watch a live "Thinking Trace" as the AI reasons through TCM principles in real-time, providing total transparency into how it synthesizes a 5,000-year-old tradition.
  • Multimodal Vitality Analysis: By natively processing high-resolution tongue imagery and voice-reported symptoms (e.g., "I feel sluggish after meals") in a single pass, the AI provides high-fidelity wellness insights.
  • Organ Function Balance: An interactive Radar Chart visualizes Zàng-Fǔ organ health, scoring vitality from 0 to 100 to identify primary imbalances like Spleen-Dampness or Heart-Fire.
  • Proactive Wellness Prescriptions: The app generates a dynamic action plan, including personalized dietary guides (like Si Shen Tang), acupressure points, and targeted Qi Cultivation exercises.
  • Trend Monitoring: A dedicated panel tracks constitutional shifts over time, showing real-time improvement percentages for vital indicators.

How we built it

We leveraged a state-of-the-art agentic architecture to ensure a "humane" and responsive user experience that bridges ancient wisdom with future tech.

  • Rapid Prototyping & Validation: We utilized Google AI Studio to quickly prototype our core reasoning engine and validate the multimodal TCM analysis logic. This allowed us to iterate through complex "Ancestral Reasoning" prompts and observe the model's high-fidelity thinking in a sandbox environment before migrating the project to GitHub for local development and production-grade version control.
  • The Reasoning Agent: We utilized Gemini 3 Flash with thinkingConfig set to HIGH. We deliberately chose Gemini 3 Flash over the larger Pro model because our goal was a 'scan-and-go' experience. Flash provided the perfect balance: its reasoning capabilities are deep enough to handle complex TCM pattern matching, but its latency is low enough to keep the user flow under 2 seconds—making daily health checks frictionless. This allows the model to perform deep, PhD-level reasoning, outperforming previous models on complex multimodal understanding benchmarks while delivering responses up to 3x faster than the 2.5 series.
  • Edge Orchestration: A Cloudflare Worker manages the streaming pipeline, leveraging global edge nodes to deliver "thoughts" and "dashboard manifests" with sub-second latency, ensuring the wellness experience remains "calm" and instantaneous.
  • Data Strategy: We used Firebase Storage for secure, high-resolution image handling and Firestore to track longitudinal vitality trends.
  • PWA & Guided Capture: The interface is a fully installable PWA featuring a Virtual Chin Rest overlay to standardize mobile camera captures for clinical-grade accuracy.

Would you like me to help you draft a "Technical Stack" section for your README that details the specific versions and libraries used in this architecture?

Challenges we ran into

One major hurdle was "translating" complex TCM patterns into Western wellness goals. We had to rigorously engineer our instructions to ensure the AI focused on outcomes—like clearing brain fog or easing bloating—rather than just listing ancient terminology.

Standardizing image quality across diverse smartphone cameras was another difficulty. We solved this by implementing a Virtual Chin Rest UI overlay that guides users to the perfect distance and lighting. We also addressed the "clinical gap" by reframing the app as a Data Hub that empowers users to share their visualized history with registered practitioners for more effective care.

Accomplishments that we're proud of

  • Democratizing Health Literacy: Turning a specialized clinical skill into a tool accessible to anyone with a smartphone, bringing hardware-level diagnostic value to the palm of your hand.
  • High-Fidelity Reasoning: Successfully implementing the "Thinking Scroll," which provides complete transparency into the AI's logic—a breakthrough in building user trust for AI wellness.
  • Clinical-Grade Visuals: Successfully replicating the insights of expensive clinical scanners through our Organ Balance Radar and Trend Monitoring systems.
  • Universal Access: Achieving sub-2-second analysis time on the edge, making proactive health management a seamless daily ritual.

What we learned

We learned that in North America, Utility is King. While the history of TCM is fascinating, users primarily care about how the tool helps them feel better today. This led us to focus our AI's "Reasoning" on practical outcomes like cognitive clarity and digestive comfort.

From a technical perspective, we discovered that Gemini 3's reasoning depth is capable of true synthesis. It doesn't just match patterns; it understands the interplay between physical symptoms and visual signs. Most importantly, we learned that Metaphor is the Bridge—using terms like "Body System Logs" helped our users instantly grasp complex internal biological shifts.

What's next for Tongue Balance AI

  • Wearable Integration: Syncing with devices like Oura to correlate tongue patterns with sleep and heart rate variability (HRV) for a 360-degree view of health.
  • Curated Wellness Kits: Launching a line of "Balance Kits" (like Si Shen Tang) that users can order based on their AI recommendations.
  • Practitioner Portal: Building a B2B dashboard where registered TCM practitioners can view their patients' "Vitality Trends" for more precise, data-driven treatments.
  • Global Accessibility: Expanding our localization to support even more communities seeking a bridge between ancient wisdom and modern harmony.

Built With

Share this project:

Updates

posted an update —

Update: Expanded Multilingual Support & Mobile Fixes

We have rolled out improvements to language accessibility and mobile UI.

Multilingual Expansion

We have expanded translation support to cover the full Homepage and detailed Analysis Reports.

  • Now Supporting: English, Chinese, and French.
  • Action Item: If you notice any inaccuracies in the TCM terminology translations, please report them!

Bug Fixes

  • Mobile Tooltips: Fixed a layout issue where tooltips were cut off on mobile screens. Definitions now display correctly on all devices.

Gemini3 #HealthTech #OpenSource #DevUpdate

Log in or sign up for Devpost to join the conversation.