OraclePlant

Inspiration

I’ve always been fascinated by the intersection of IoT, AI, and human-plant interaction. I wanted to create a project that brings plants “to life,” giving them a voice to express their needs and moods. Watching smart gardens and AI assistants inspired me to combine sensor data with AI-generated messages and text-to-speech technology.

What it does

OraclePlant is an interactive IoT system that monitors your plant’s environment and generates fun, personalized audio messages about its mood. Using sensors for temperature, humidity, light, and soil moisture, the system calculates the plant’s "mood" and uses AI (Gemini) to create a short message. This message is then converted to speech using ElevenLabs TTS, so your plant can “talk” to you in real-time.

How we built it

  • Hardware & IoT: Sensors simulate plant conditions (temperature, humidity, light, moisture).
  • Server & API: Node.js + Express handles incoming sensor data, mood calculations, AI generation, and TTS audio creation.
  • AI Integration: Gemini API generates fun, plant-specific messages based on sensor readings.
  • Text-to-Speech: ElevenLabs API converts the AI-generated messages into audio files that can be played in a web dashboard.
  • Dashboard: A simple front-end polls the server and plays new audio whenever the plant's mood changes.

Challenges we ran into

  • Managing asynchronous calls to Gemini and ElevenLabs APIs without blocking the server.
  • Avoiding duplicate audio generation and handling cooldowns between messages.
  • Handling 401 and other authentication errors with ElevenLabs API.
  • Ensuring the front-end updates reliably with new audio and sensor data.
  • Sometimes problems are not your fault — it’s a learning process, and debugging those issues was key.

Accomplishments that we're proud of

  • Successfully gave a “voice” to plant sensor data.
  • Seamless integration between IoT simulation, AI, and text-to-speech.
  • Implemented a robust polling system on the dashboard that avoids overlap and plays audio reliably.
  • Learned to handle API rate limits, authentication errors, and asynchronous programming in Node.js.
  • Discovered the limits of ElevenLabs API first-hand — yes, I “broke” it!
  • Learned that Gemini TTS is a paid feature, which taught me to work within API constraints.

What we learned

  • How to combine IoT data with AI-generated content and TTS.
  • Best practices for API error handling and cooldown management.
  • How to build a responsive web dashboard that reacts to real-time data.
  • The importance of debugging asynchronous workflows in Node.js.
  • University networks can be tricky, sometimes rejecting seemingly reasonable requests.
  • Unexpected API behaviors can happen — like “unusual activity detected” messages — and you learn to adapt.

What's next for OraclePlant

  • Add real sensors for a physical plant setup.
  • Enhance the AI messages with more personality and context awareness.
  • Include multi-plant support, so each plant can have a unique voice.
  • Explore mobile notifications or integration with smart home devices for plant care alerts.
  • Add Spotify integration for “in-the-mood” plants, exploring studies that suggest sound affects plant metabolism.
  • Build a mesh network of multiple plants so they can “communicate” with each other.
  • Could this be used in aquariums to monitor water parameters, meaning water can be saved by only doing water changes when needed.

Built With

  • audio-playback-with-html-`<audio>`-element
  • axios
  • built-with-**languages:**-javascript-(node.js)
  • but-gemini-and-elevenlabs-are-cloud-apis-**databases:**-none-(state-is-kept-in-memory)-**other-tools:**-web-browser-for-dashboard
  • css-**frameworks-&-libraries:**-express.js
  • dotenv-**platforms:**-raspberry-pi-(simulated-sensors)-**apis:**-gemini-api-(ai-message-generation)
  • elevenlabs-tts-api-(text-to-speech)-**cloud-services:**-none-(all-processing-is-local)
  • html
  • in
  • python
  • script
  • simulation
Share this project:

Updates

posted an update —

OraclePlant – Hackiest Hack

Over-the-Top, Held Together with String

OraclePlant fully embraces the spirit of the Hackiest Hack challenge. The project is a playful, over-engineered system that combines IoT sensors, AI, and text-to-speech in a way that’s both imaginative and slightly chaotic—just like the challenge asks.

We’ve built a plant-monitoring system using Raspberry Pi, simulated sensors, and a mix of APIs, all orchestrated with Node.js and a web dashboard. While the underlying technology is solid, the way it all comes together—bridging physical plants, AI messages, and audio output—is delightfully “held together with string.”

Creativity and Imagination

  • IoT meets AI: Sensors capture real-world data, AI interprets it, and TTS gives the plant a voice.
  • Fun and whimsy: The plant talks in a humorous, personalized way based on its “mood.”
  • Over-engineered charm: The project may use more moving parts and API calls than strictly necessary—but that’s part of the fun.

OraclePlant exemplifies creative chaos, demonstrating that sometimes the most memorable hacks are the ones that are clever, slightly absurd, and bursting with imagination. It’s a project that’s quirky, over-engineered, and proudly held together with a metaphorical (and sometimes literal) string.

posted an update —

OraclePlant – Bridging Worlds

Connecting the Physical and Digital Worlds

OraclePlant is a project that bridges the gap between the natural world and the digital world. By using IoT sensors to monitor a plant’s environment—temperature, humidity, light, and soil moisture—we transform real-world data into meaningful insights about the plant's “mood.” This data is then interpreted by AI (Gemini) to generate messages that humans can understand and relate to.

Human-AI Collaboration

OraclePlant demonstrates human-AI collaboration in action. The AI doesn’t replace human interaction—it enhances it. By turning sensor data into fun, personalized messages and converting them into speech with ElevenLabs TTS, the AI allows people to experience their plants in a new, interactive way. This system creates a dialogue between humans and plants, mediated by technology.

Mapping Data Between Domains

The project maps environmental data (physical sensors) into a digital language (AI-generated messages), and finally into audio output. Each step bridges a different “world”:

  • Physical → Digital: Sensors capture real-world conditions
  • Digital → Semantic: AI interprets these readings as meaningful text
  • Digital → Human Experience: TTS converts text into human-understandable audio

Why This Matters

OraclePlant bridges worlds to create empathy, awareness, and engagement. Users become more attuned to their plants’ needs while also exploring the potential of AI to translate complex data into relatable, actionable experiences. Beyond plants, this approach could be applied to environmental monitoring, smart homes, or any system where data exists in one world but needs to be understood in another.

posted an update —

Connectivity Challenges with Durham's Eduroam on Raspberry Pi

During the development of OraclePlant, we ran into some unexpected network issues when trying to connect our Raspberry Pi to Durham University's eduroam Wi-Fi. While eduroam works seamlessly on laptops and mobile devices, the Pi presented unique challenges.

The Problem

  • The Raspberry Pi failed to authenticate on eduroam repeatedly.
  • Standard Wi-Fi credentials did not work as expected due to enterprise-level security protocols.
  • Some attempts triggered unusual activity alerts, temporarily blocking our Pi’s access.
  • This caused intermittent connectivity, which affected real-time updates between the Pi sensors and the server.

Why This Happens

  • Enterprise Authentication: Eduroam uses WPA2-Enterprise with certificates and EAP methods that require proper configuration.
  • Device Limitations: Some lightweight or embedded devices struggle with certificate-based authentication.
  • Network Security Measures: Unusual network behavior from automated scripts or frequent reconnections can be flagged as suspicious.

Workarounds We Explored

  • Using alternative networks (personal hotspots) to bypass the restrictions temporarily.
  • Configuring wpa_supplicant with the correct EAP settings and CA certificates.
  • Testing scripts in a local network environment before deploying on eduroam.

Lessons Learned

  • For IoT projects in university networks, plan for network compatibility early.
  • Always test devices on both open networks and secured enterprise Wi-Fi.
  • Network policies may require approval for automated devices or Raspberry Pi deployments.

Even though this issue slowed down real-time IoT updates, it taught us valuable lessons about working with enterprise networks and the limitations of embedded devices in such environments.

posted an update —

What’s Next for OraclePlant

OraclePlant has been an exciting experiment in combining IoT, AI, and text-to-speech technology to give plants a “voice.” But this is just the beginning. Here’s how I plan to take this project further:

1. Real Sensors & Physical Plants

  • Move from simulated data to real sensors for temperature, humidity, soil moisture, and light.
  • Set up physical plants that can actually respond in real-time to their environment.

2. Multi-Plant & Personalized Voices

  • Support multiple plants at once, each with a unique voice and personality.
  • Use AI to customize messages based on the species, health, and preferences of each plant.

3. Smart Home & Notifications

  • Integrate with smart home devices to alert users when plants need water, light, or attention.
  • Provide push notifications or audio reminders, turning plant care into a seamless experience.

4. Enhanced AI Personality

  • Expand Gemini prompts to create richer, more expressive messages.
  • Include mood-based storytelling, playful interactions, or fun facts about plants.

5. Environmental & Educational Impact

  • Turn OraclePlant into a teaching tool for sustainability, plant care, and AI learning.
  • Monitor environmental conditions to improve plant health and reduce resource waste.

6. Community & Collaboration

  • Allow users to share their plants’ personalities or collaborate on a network of “talking gardens.”
  • Explore mesh networks where plants “communicate” to optimize care and environmental monitoring.

OraclePlant is just getting started. The goal is to combine technology, creativity, and sustainability to make plant care engaging, educational, and fun—one leafy conversation at a time!

posted an update —

OraclePlant: AI, IoT, and a Little Duct Tape Magic

Sometimes, the best innovation doesn’t come from expensive hardware—it comes from creativity, resourcefulness, and a bit of duct tape and string. OraclePlant is a perfect example of how a hacky, hands-on approach can bring AI and IoT together to make plants talk and interact with us.

Holding It All Together

  • The project started with simple IoT sensors for temperature, humidity, light, and soil moisture.
  • Using Node.js and Express, the server collects sensor data and feeds it into AI (Gemini) to generate fun, plant-specific messages.
  • ElevenLabs TTS converts these messages into audio so your plant literally speaks to you.
  • And yes—some components were literally held together with duct tape and string! Wires, sensors, and microcontrollers all found their place in a creative, temporary setup that just works.

Why It Matters

  • Demonstrates that you don’t need a lab full of equipment to prototype smart devices.
  • Encourages hands-on learning and problem solving, showing that ingenuity matters more than perfect tools.
  • Embraces the hackathon spirit: build fast, improvise, and iterate.

Lessons Learned

  • Sometimes, a little duct tape goes a long way. It’s not just about holding components—it’s about making ideas tangible.
  • Combining AI, IoT, and resourcefulness can create engaging, functional prototypes, even without polished hardware.
  • Creativity and ingenuity often outweigh technical perfection in early-stage projects.

OraclePlant proves that with a few sensors, some AI magic, and a bit of tape, you can bring your plants to life and inspire curiosity and fun in the process.

posted an update —

OraclePlant: Bringing AI and IoT Together for People and the Planet

OraclePlant isn't just a fun, interactive project—it has real-world potential to improve both human well-being and environmental stewardship. By combining IoT sensors, AI-generated insights, and text-to-speech, we can create plants that "talk" and help us make smarter decisions about plant care and sustainability.

Real-World Benefits

1. Environmental Awareness

  • OraclePlant can monitor soil moisture, light, temperature, and humidity in real-time, alerting users to overwatering, drought, or extreme conditions.
  • By optimizing water usage and plant health, it helps reduce waste and conserve resources in both homes and urban gardens.

2. Mental Health & Wellbeing

  • Interacting with talking plants encourages mindfulness and responsibility, offering a simple, stress-relieving connection to nature.
  • AI-generated messages can provide encouragement and guidance, creating a playful and positive indoor environment.

3. Educational Applications

  • Students can learn about plant biology, ecosystems, and the impact of environmental factors on living organisms.
  • Developers and educators can use OraclePlant as a hands-on example of AI and IoT integration, sparking innovation and curiosity.

4. Smart Agriculture

  • Scaling OraclePlant to greenhouses or urban farms could provide automated alerts and insights to reduce crop failure and optimize growth conditions.
  • Combining AI analysis with environmental sensors could support sustainable food production and reduce the carbon footprint of farming.

Looking Ahead

OraclePlant shows how AI and IoT can empower humans to care for plants, save resources, and enhance wellbeing. With multi-plant setups, smart notifications, and integration with sustainable practices, we see a future where plants can actively contribute to a greener, healthier world.

posted an update —

Project Update: ElevenLabs API Rate Limiting

During development, we encountered an unexpected issue with the ElevenLabs Text-to-Speech API. Our server was generating multiple AI messages in rapid succession as the plant mood changed, and we started seeing 401 errors with a response indicating “unusual activity detected.”

This revealed that our API key had exceeded its allowed request rate. While this initially caused audio generation to fail, it provided an important learning opportunity:

  • We implemented cooldown logic in our server to limit TTS requests to one per 20 seconds.
  • We improved error handling to log API responses more clearly, ensuring we can respond to rate limits or authentication issues in real-time.
  • We learned how to balance asynchronous AI calls with API usage constraints, which is crucial for any system relying on external cloud APIs.

Now, the OraclePlant system generates audio reliably without triggering rate-limit errors, and the plant dashboard continues to update mood-based messages seamlessly. This experience highlighted the importance of handling API limits in interactive IoT and AI projects.

Submission history