Inspiration

Truffle is based on my real cat. When I was overwhelmed or emotionally drained, my cat was the one constant that helped me feel calm and grounded. I wanted to build something that could bring that same kind of steady, non‑judgmental comfort to other people especially those living with mental disabilities who need support that feels safe, patient, and consistent.

What I Built

Truffle is a 3D, voice‑first AI companion that listens, detects emotional tone, and responds with a warm, human‑like voice. It keeps memory of the user’s preferences and emotional patterns so each conversation gets more personal over time, rather than starting from zero every time. The goal was to make it feel like a real companion, not just a chatbot.

How It Works (Simple View)

The user speaks Speech‑to‑text converts audio to words An AI model generates a response Text‑to‑speech speaks it back in a tone matched to the user’s emotion Memory stores what matters (name, preferences, concerns, comfort style)

What I Learned

I learned how much trust depends on small details: voice warmth, response pacing, and memory consistency. I also learned that reliability matters more than raw intelligence if the assistant fails even once, the experience breaks. That pushed me to prioritize stability, speed, and emotional consistency over fancy features. Challenges Accurate speech‑to‑text: Real‑world audio is messy. I had to improve capture, normalize the signal, and tune the recognition pipeline. Latency: Slow responses break the conversation. I optimized the flow so replies start quickly after the user stops speaking. Emotional realism: It’s not enough to sound kind. The assistant has to be natural, honest, and not overly “scripted.” Memory trust: Memory is powerful, but it has to be careful and respectful, not intrusive or repetitive.

Why It Matters

This project is built for people who need support that feels steady, calm, and human. It’s not a medical tool it’s a companion that listens, remembers, and speaks back with empathy and realism. For someone who feels unseen, that can make a real difference.

Built With

• backboard
• elevenlabs
• gemeni
• gradium
• html
• javascript
• languages:-python
• openrouter-(fallback)