Inspiration
AI wearables promise a lot, yet few people wear them. The reasons are always the same: people worry the device is always listening, it looks odd and doesn't reflect who they are, and they have no real reason to carry one. We asked what would make someone want to carry an AI device. Our answer: something small, affordable and collectible that brings joy and sparks social connection — the care of a Tamagotchi, the get-out-and-explore pull of Pokémon Go, and an AI assistant that only listens when you ask.
What it does
Charmers is an AI charm for your bag that you grow, play with your friends, and talk to.
Fun
- Grow your Charmer. Every Charmer is rolled with its own stats, like a game character: Wit, Dexterity, Charm, Wisdom and Health. Real life grows them: talking to it grows Wit, winning mini-games grows Dexterity, meeting other Charmers grows Charm, and exploring new kinds of places grows Wisdom. A "?" next to every stat explains exactly why it grew.
- Build your world. The map starts as a dark, blank page and fills in 5 ft at a time wherever you go, as pixel districts of meadow, water and stone, with a glowing marker wherever you talked to your Charmer.
- Play in person. Screenless mini-games, Charmer against Charmer: Quick Draw, Pattern Duel and Bop-It. Beating a stronger Charmer grows yours more.
Useful
- Tap and talk. Double-tap the charm (or press Talk in the app) and speak. It turns what you said into a short summary and to-dos and saves them to Notion.
- Private by design. It only listens after a tap, with its light solid blue while it does. Transcripts never leave the laptop, only the summary and to-dos, and the places you explore stay on your phone.
How we built it
- The charm: a Vexo Open band (motion sensor, microphone, colour LED) running our Python pipeline. A band layer turns gestures into events, a brain handles speech (Deepgram) and summaries (OpenAI), and outputs send results to Notion and to a live feed for our apps. A small shared JSON contract kept every layer independent, so our team could build in SF and NYC at the same time.
- The app (Flutter): four tabs. Voice (talk button and history), World (a pixel-voxel map drawn natively and cached on the GPU, with GPS or a demo walk, drag and pinch, and a top or isometric view), Game, and Stats (a radar and voxel meters whose growth rules explain themselves).
- The shells: five charm designs from Clayground, our own parametric shell designer, ready to 3D print. The demo page renders them in 3D (React + three.js) beside the live app in a phone, built with Clayground's own geometry code. Tap the charm's Core on screen and the real band flow runs, its ring turning blue while it listens.
Challenges we ran into
- Making privacy real, not just a claim: tap-to-listen, a visible light while listening, and a team rule that transcripts never leave the laptop.
- Finding a game that's fun without a screen, and making the stats actually change gameplay instead of just sitting on a chart.
- Keeping three codebases in sync — Python, Flutter and the React showcase — through one event contract, with teammates in two time zones pushing at once.
- Making the map feel discovered, not drawn (fog, grain, crumbly edges, dust that blows off as you reveal ground) while staying smooth on a phone.
Accomplishments that we're proud of
- The full loop works end to end: tap the band (or the 3D charm), speak, and a summary lands in the app and Notion while the light confirms it.
- A world, stats and games that feed each other: what you do in one grows the others.
- Real, printable shells designed in our own tool and shown live in 3D.
What we learned
People don't want another gadget; they want something that's theirs. Making AI personal, playful and visibly private matters more than adding features. And in-person play gives an AI wearable what none has had before: a reason to meet up, and a reason for your friends to get one too — network effects.
What's next for Charmers
- Mini-games played charm to charm, starting with Quick Draw and Pattern Duel.
- Personality that shapes the world: a fiery or mellow Charmer gets a matching map style.
- Stats that grow from the sounds around you (study, concerts, the outdoors) without ever storing what was said.
- Printed shells in collectible batches with random stats per Charmer, at a toy price ($10–20), in a collectibles market worth over $600 billion, with the AI assistant as a subscription.