Inspiration Every AI interface is a chat box. I wanted something that felt alive — and Iron Man's Jarvis was the reference: the hologram materializes mid-sentence. So: what if the face you talk to could become what you're discussing?

What it does A wireframe icosahedron morphs into a talking face when you click it. Speech-to-speech voice, no typing, real barge-in. Ask it to make something — "summon a wide hourglass" — and it synthesizes the shape and morphs its own 478-point mesh into it, live. Sixteen summons are instant from a curated library; anything else gets synthesized. It never crashes — worst case, a weird abstract blob.

How we built it No build tools. One index.html, Three.js, GSAP, a WebRTC Realtime voice pipeline. The LLM writes shape specs (parts, profiles, modifiers) — not geometry — and our own SDF kernel turns that DNA into a 478-point mesh. Server caches everything; tests run against a stubbed DeepSeek.

Challenges 478 points makes everything unforgiving: thin features vanished when probes stepped over them, an hourglass collapsed to a spindle from a wrong surface-crossing, and a polar_repeat bug drew one crown spike thirteen times. And the model building it couldn't see images — so I built ASCII-silhouette tooling to "look" at shapes blind.

Accomplishments A live site where the face morphs into 16 summons plus anything the synthesis engine dreams up. Named parts survive the weld, so "show me the legs" is a lookup. Explode mode with canvas labels. Zero crashes — every failure degrades gracefully.

What we learned Legibility beats fidelity. An LLM should write the DNA, not the coordinates. Cache everything. If you can't see, build tooling that lets you see.

What's next An everyday human-computer interface — reminders, lookups, weather, ideas made visible. Named parts are the start of an Explainer that labels what it shows. Specs-as-DNA make a Memory Palace cheap — objects persist as a few KB of JSON. And text-to-3D GLB generation is already waiting in the schema.

Built With

Share this project:

Updates

Submission history