Dolores

• 

  Simulation of Museum Visitors

• 

  Heathmap of Emotions

• 

  Heathmap

Dolores

What if a museum could listen, learn, and evolve? Most audio guides are static. You press a number, hear the same script everyone else hears, and move on. Dolores is different. She's an ambient AI museum agent that senses how visitors feel, responds to their actual questions, and uses every interaction to get smarter over time.

Here's how it works. You just walk up to a painting, say for example, Van Gogh's Wheat Field with Cypresses and Dolores detects you through Bluetooth beacons and starts narrating automatically. She knows which artwork you're standing in front of, and she begins talking to you about it. It's completely hands-free. That's what makes her an ambient agent — she initiates the conversation, not you.

But it's not a one-way script. You can interrupt at any point — "Why are the cypresses so dark?" — and Dolores answers in real time using Gemini's Live Audio API. And here's where it gets interesting: Modulate's voice intelligence API analyzes the conversation and emotional tone of your speech. Are you curious? Moved? Confused? Dolores calibrates her response to match. A visitor feeling sad in front of The Potato Eaters gets a different answer than someone who's simply curious.

Now here's what curators see. This is a real-time simulation of the Van Gogh Museum, 12 artworks across multiple galleries. Each dot is an autonomous visitor moving through space. On the right, you can see emotions by artwork; Sunflowers sparks excitement, Wheatfield with Crows draws more sadness, Almond Blossom evokes hope. Below that is a live Q&A feed showing what visitors are actually asking and how Dolores responds. This gives curators a live read on exhibit performance. No clipboard surveys needed.

But the third layer is what makes Dolores a true agent. Analytics for better curation. See this "Evolving descriptions." Every hundred visitor interactions, the system analyzes patterns: which paintings get the most questions, what emotions come up most, which answers fall flat. It feeds all of that into Claude, which rewrites exhibit descriptions and Q&A responses automatically. Popular paintings get richer detail. Neglected ones get more compelling hooks. Each wave of visitors literally makes the next wave's experience better.

Dolores is three things in one: an ambient, conversational guide for visitors, a live analytics tool for curators, and a self-improving agent that evolves with every interaction. Built with Gemini, Modulate, and Claude.

Built With

• claude
• gemini
• modulate