Inspiration

I personally struggled with scattered chats, voice notes, forgotten tasks, and files. I wanted one AI-powered space to centralize all content, reflect daily, and stay on top of important tasks.

What it does

  • Centralizes text, audio, video, and document chats
  • AI-powered memory: search past conversations & files - WIP
  • Daily 3‑3‑1 journaling and full-page diary entries - Next-Planned-Module
  • Auto calendar event creation and push reminders - Next-Planned-Module

How I built it

  • Frontend: React + Tailwind for chat, journal, and upload flows
  • Backend: Node.js + Express + MongoDB
  • AI integrations:
    • Whisper for transcription - WIP
    • GPT for memory indexing, summarization, and context recall - WIP
    • Calendar API and push notifications for reminders - Next-Planned-Module
  • Journal module: structured daily prompts (3 good, 3 challenges, 1 highlight) - Next-Planned-Module

Challenges we ran into

  • Designing a trusty memory retrieval engine prioritizing relevance and context - WIP
  • Ensuring transcript accuracy and seamless integration with chat memory - Next-Planned-Module
  • Balancing reminder sensitivityβ€”trigger events without excess noise - Next-Planned-Module

Accomplishments that we're proud of

  • Built a full multimodal chat interface (text/audio/video/docs) with AI-powered memory - WIP
  • Deployed journaling + reminder automation in a live demo - Next-Planned-Module
  • Achieved end-to-end flow from chat β†’ journal β†’ calendar event - Next-Planned-Module

What we learned

  • How to index and summarize multimodal data effectively
  • Real-world integration of Whisper and GPT APIs
  • UX design for natural, intuitive flows between chat, memory, and reflection

What's next for AI Personal Assistant Project

  • Add smart AI coaching: mood/emotion detection + personalized insights - Next-Planned-Module
  • Build weekly/monthly summary reports and retrospectives - Next-Planned-Module
  • Expand integrations: Google Calendar, task tools (Todoist, Notion) - Next-Planned-Module
  • Launch mobile apps with push support and offline journaling - Next-Planned-Module

Built With

Share this project:

Updates