Inspiration

As a university student with a deep interest in mental health, AI, and emotional well-being, I often felt the need for a space where thoughts, moods, and daily experiences could be captured—not just textually, but emotionally. Traditional diary apps felt too robotic or basic. I wanted to build something that feels like talking to a friend, not filling out a form.

That’s how Memorify was born — an emotionally intelligent, AI-powered smart diary that listens, reflects, and responds.

What it does

Memorify is more than just a diary — it's a calm, empathetic AI companion built to:

  • ✨ Chat with users in a reflective, friendly tone (powered by Together.ai and ElevenLabs for voice)
  • 📝 Automatically convert conversations into thoughtful, mood-aware diary entries
  • 🖼️ Generate emojis to visually represent the user’s emotional state
  • 📆 Organize entries in a beautiful, timeline/calendar-based interface with color-coded emotional tags
  • 📊 Provide weekly emotional insights & self-growth reflections using agentic memory logic

How I built it

  • Frontend: Built in React (Vite + TailwindCSS + ShadCN for modern UI)
  • AI Integration: Together.ai for chat + diary generation ElevenLabs for voice-based emotional response
  • Agentic Memory: Emotion + behavioral pattern tracking stored in Supabase
  • Backend: Supabase (Auth + Realtime DB + storage)
  • Deployment: Deployed as a PWA using Netlify

Challenges I ran into

  • 😵‍💫 Emotion detection logic needed fine-tuning — it always gave same intensities initially
  • 😤 Supabase constraints (like enum values) caused 400 errors during insertions
  • 😭 OpenRouter quota ran out — had to pivot to Together.ai API
  • 💸 Budget: I had to build this entirely free — no paid APIs or cards accepted locally (Rip RuPay 🪦)

Accomplishments that I am proud of

  • Built a functioning Agentic AI loop with real emotion tracking and proactive check-ins
  • Used Together.ai in an innovative way to simulate a therapy-like writing coach
  • Integrated ElevenLabs voice for real emotional connection with users
  • Designed a soothing, functional, mobile-first UI with emotion-colored themes

What I learned

  • Deep understanding of agentic AI design patterns
  • How to integrate multiple AI APIs (text + voice) together in one loop
  • Better Supabase querying & error handling
  • How important tone, mood, and personalization are in human-AI interaction

What's next for Memorify

  • Enable Google Photos sync for daily image tagging
  • Add voice input and daily voice reflection playback
  • More nuanced AI personas: therapist, poet, coach, friend
  • Publish on ProductHunt and seek mental health partnerships
  • Wrap into a Flutter-based mobile app for Android/iOS

Built With

  • aiagent
  • bolt.new
  • elevenlabs-api
  • netlify
  • pwa
  • react
  • shadcn
  • supabase
  • tailwindcss
  • together.ai
  • vite
Share this project:

Updates

Submission history