Lumi – AI-Driven Evolutionary Mindfulness Companio

Lumi leverages Gemini 3’s long-context memory and multimodal API to evolve a digital companion based on user stress. It transforms stale meditation into an engaging, AI-driven emotional journey.

Comment

Inspiration

As a product designer with 15 years of experience, I noticed a paradox: we use technology to escape the stress that technology itself often creates. I wanted to move beyond "utility apps" that feel like chores. Inspired by the nurturing mechanics of Pokémon Sleep and the gamified progression of Duolingo, I envisioned Lumi—a sentient companion that doesn't just track your silence but evolves through your emotional growth.

What it does

*Lumi is an "Evolutionary Mindful Companion." Unlike traditional apps, Lumi is a digital life-form powered by Gemini 3. *Sentient Growth: Lumi starts as a fragile wisp of light (Level 1) and evolves into a radiant celestial guardian (Level 50+) as the user completes meditation and emotional management courses. *Emotional Metabolism: Using Gemini 3, Lumi "absorbs" and "metabolizes" user anxiety or anger, transforming negative inputs into visual growth and experience points. *Proactive Memory: Lumi remembers past stressors (e.g., a meeting from last week) and proactively offers "Magic Card" interventions before the user reaches a breaking point.

How we built it

The project is a synergy of high-end design and advanced AI orchestration: *The Brain: We utilized Gemini 3 (via AI Studio) to manage a "Long-term Memory Context," allowing Lumi to maintain a consistent persona and recall user history across sessions. *The Interface: Developed with a minimalist, glassmorphic UI in Figma, focusing on intuitive, "zero-menu" interactions where Lumi is the central focal point. *The Persona: We integrated ElevenLabs for an empathetic, human-like voice and Luma Dream Machine to generate the cinematic, evolving visual assets of the Lumi character. *The Logic: The app’s curriculum is built on a structured state machine, branching based on user heart rate (simulated) and linguistic sentiment analysis.

Challenges we ran into

The primary challenge was Translating Intelligence into Empathy. It was difficult to ensure that the AI didn't sound like a clinical assistant. We had to carefully tune the System Instructions to allow Lumi to express its own "feelings" and "sleepiness," mimicking a biological rhythm. Technically, balancing the high-fidelity visual evolution with smooth mobile performance required significant optimization of the asset delivery pipeline.

Accomplishments that we're proud of

We are incredibly proud of the "Emotional Metabolism" feature. Seeing a user’s typed-out anger visually dissolve and be absorbed by Lumi, resulting in a physical evolution of the character, creates a profound psychological "release" that traditional apps cannot replicate. We also successfully implemented a Long-Context Memory that makes Lumi feel like a friend who truly knows you.

What we learned

problems" but about "shared experiences." We learned that users are more likely to stick to a mindfulness routine when they feel responsible for the growth of another being. From a technical standpoint, we discovered the immense power of Gemini 3 in handling multi-modal emotional inputs to drive real-time UI changes.

What's next for Lumi – AI-Driven Evolutionary Mindfulness Companio

The vision for Lumi is to move beyond the screen. We are exploring Spatial Computing (MR) integration, where Lumi can float in your actual room, reacting to your environment and heart rate sensors in real-time. We aim to build a "Global Resonance" feature where users can see a collective "Emotional Weather Map," allowing the world to heal together, one breath at a time.

Built With

  • 3d-style
  • aistudio
  • and
  • and-the-"emotional-state-machine"-logic.-design-&-prototyping:-figma:-for-the-high-fidelity
  • assets
  • character
  • core-ai-engine:-*-gemini-3-api-(google-ai-studio):-used-for-the-long-context-memory-window
  • environment
  • glassmorphic-ui/ux-design-and-design-system-architecture.-cursor:-used-as-the-primary-ai-integrated-code-editor-for-rapid-prototyping-and-frontend-development.-media-&-persona-generation:-elevenlabs:-for-generating-the-empathetic
  • high-quality-english-voiceovers-and-lumi?s-character-voice.-midjourney:-to-generate-the-high-resolution
  • proactive-emotional-analysis
Share this project:

Updates