Mirror.ai

• 

  Initial page that greets user when starting new conversation

• 

  Talking to AI with just the voice, it gives personalized answers

• 

  Memories page with informations about the person

Inspiration

ChatGPT voice mode is nice but it doesn’t understand you, your habits and your plans.

What it does

Mirror.ai is a hyper-personalized AI assistant which knows you better with every conversation, and data from your location, calendar, health information and more. It acts as your personal coach disguised in your favorite voice – our favorite being our own.

How we built it

From a technical perspective we're leveraging Next.js (framework for creating Fullstack applications) combined with Vercel AI SDK which provides first-class when using LLM, in our case we're using Mistral leading models.

We leverage tool calls for creating, updating and deleting memories making it possible to AI to securely store informations about the person, so it becomes your best assistant.

We instruct the assistant to be aware of key 11 personal traits that describe the user’s personality based on the Big Five model from psychology, their values, life history, social and environmental context and health, while using it on-the-go.

To embrace the inner voice and mirroring experience of the AI, users can give their voice to the AI assistant powered by ElevenLabs. Settings → Custom Voice Settings

Here’s the link to repository containing a project that we created: https://github.com/callstackincubator/2025-hackaton

Challenges we ran into

RAG to improve speed (no time) Echo detection when not on a headset nailing the UX that’s voice-first streaming audio responses (no time)

Accomplishments that we're proud of

Offline web-based speech recognizing running locally which is accessible in majority of modern browsers, very fast powering our prototype.

Inline display of incoming audio word-by-word.

Create first integrations e.g. with Calendar, WhatsApp so AI prepares everything for you - all you need to do, and that's only for some integrations is to press "Submit" button.

A model for describing a person in multiple vectors based on scientific research to grasp their essence and provide an assistant that’s friendly.

What we learned

We ensured ourselves that current tooling that mainly comes for free on the base plans enables even for non-technical people.

What's next for Mirror.ai

Massive amounts of 3rd party integrations, so it’ll contain information about your calendar, about your health statics (e.g. with Apple Health including data about sleep, stress etc.), so your mirrored yourself would know about the things that are happening currently in your life and you won’t need to provide everything to it by talking. By adding integration with make.com it’d enable Mirror.ai for endless possibilities and opportunities.

Built With

• ai
• mistral
• next.js
• vercel