An AI-powered, IoT-based device that wraps around a plant stem and transforms real plant electrical signals into emotional conversations and music.

🌱 PlantBuddy: The Screen-Free Living Interface for Wellness Bridging nature and mental health through real-time bio-signals and "Data in Motion"—no screens required.

💡 Inspiration Emotional loneliness is a silent epidemic, yet digital solutions often feel cold and impersonal. We asked: What if a plant—a non-judgmental, grounding being—could become a partner in your mental health journey? PlantBuddy merges the calming presence of nature with high-frequency AI, creating an "Emotional Data Economy" where your growth is nurtured by the very plants you care for.

🚀 What it Does PlantBuddy is a high-fidelity, all-in-one IoT companion that transforms a plant’s micro-electrical signals into a multi-sensory human experience.

🗣️ Hands-Free Conversations: Featuring an integrated microphone and speaker, PlantBuddy allows you to talk to your plant as naturally as a friend. There is no need for a phone or screen—just speak, and the plant "talks back" using expressive, empathetic AI voices.

🎙️ The Living Therapist: Touching the plant initiates a real-time stream to Confluent Cloud. Using Google Vertex AI (Gemini), the system analyzes the user’s voice and the plant’s "mood" to provide non-judgmental cognitive therapy sessions. It evolves from a device into a friend and a lifelong companion.

🎹 Living Piano Mode: Low-latency streaming allows touch intensity to modulate sound frequencies. Users can "play" their plant, turning biological signals into a soothing, generative musical experience.

🩺 Integrated Health Monitoring: PlantBuddy features built-in sensors that constantly track Temperature, Moisture, Soil pH, and Light. It doesn't just monitor; it communicates. Your plant will tell you through its own voice when it needs more sunshine or a drink to stay healthy.

🛠️ How it was Built (The Tech Stack) We moved away from batch processing to a Data in Motion architecture to ensure every interaction feels "alive."

Hardware: An ESP32-based integrated sensor hub with a built-in mic and speaker system. It captures micro-voltage changes and environmental metrics, streaming them via WebSockets.

The Nervous System (Confluent Cloud): Raw signals flow into Kafka topics. We use high-quality sensor data (Temp, pH, Moisture) triggers the right AI responses without delay.

The Brain (Google Vertex AI & Gemini): Gemini acts as the interpretive engine, merging live sensor "moods" with the user's vocal input to generate personality-driven, therapeutic responses.

🏆 Why it Wins (Confluent Track) PlantBuddy is a masterclass in Stream Processing. While most AI projects rely on static data, we use Apache Flink on Confluent to detect patterns in biological signals as they happen. By integrating hardware (mic/speaker) with real-time data streams, we’ve created a responsive, therapeutic companion that doesn't just live in a cloud—it lives in your room.

Built With

Share this project:

Updates