Inspiration
On winter evenings, thousands of starlings gather over marshes, piers and city rooftops and move as a single shape. Researchers found that each bird only keeps track of about seven neighbours, and that one rule is enough to produce the whole thing. I wanted to let someone hold that in their hands while sitting on their own couch.
What it does
MURMUR is a seated, controller-free evening with the starlings.
A lost starling turns up in your room at dusk. Hold up an open palm and it comes to you. A map of four lights then floats within reach: open farmland, the Danish marshes, a seaside pier and the rooftops of Rome. Touch one and your room fades into that place. You can visit them in any order.
- Open palm calls the flock, and you lead it through glowing rings.
- Pinch and draw a line in the air over the marshes, and the flock flies along it.
- Sea wind pushes the ring along the pier, so you lead the birds to where it will be.
- A fist drives off the falcon hunting over Rome.
Every place brings more of the flock home (1, 40, 250, 600, then 900 birds) and earns a field note, a real fact about how starlings live. At nightfall you are back in your own room, you lower your hands, and the birds you brought home settle around you like slow stars.
If you would rather stay in your own room the whole time, a light on the map keeps every place in passthrough instead.
How I built it
- Immersive Web SDK (WebXR, Three.js, ECS), hosted on GitHub Pages. It runs in the Quest browser with nothing to install.
- Hands: gestures are read from raw WebXR hand joints (fingertip reach, pinch distance, palm direction). There is no controller path at all.
- The flock: a boids simulation with a spatial hash. All 900 birds are one instanced mesh, with wing flapping done in the vertex shader. Like real starlings, each bird reacts to about seven neighbours. Your call steers velocities, so the stream flies through a ring instead of circling it.
- Mixed reality: the story starts and ends in passthrough, and plane detection keeps the rings in front of your real walls.
- Worlds and sound: the four places are CC0 360 degree photographs from Poly Haven, standing in for the kind of landscape at each roost. Sound is generated with the Web Audio API.
Challenges
- Early flocks orbited my hand instead of threading the rings, then collapsed into a ball. Seek-style steering and giving every bird its own drifting target fixed both.
- Everything had to work from a seat, inside arm's reach: the map, the rings and the gestures.
- Dark birds disappeared against the photographs until I gave their backs a sheen, the way real starlings catch the light.
- MURMUR was built and tested in the IWSDK emulator, so on-device tuning is the first thing on my list.
What's next
More roosts, a slower free-flight mode for winding down, and letting two people share one flock.
Built With
- api
- audio
- github
- immersive
- pages
- sdk
- three.js
- typescript
- vite
- web
- webxr