Inspiration
A school that wants to teach anatomy buys a plastic skeleton. A good one costs thousands of dollars, it lives in one room, and thirty students take turns standing around it.
We had already built a renderer that puts photorealistic Gaussian Splatting captures into the real room through passthrough. The piece that was missing was not graphics — it was that a headset is a private device. One person sees something extraordinary and everybody else watches them wave their arms.
So we built the opposite: a room where the teacher anchors a specimen on the real table and every student sees it in the same physical place, walks around it, leans in until their face is almost touching it, and turns it so the others see it turn. The specimen costs a capture session instead of a purchase order, and the classroom keeps its walls, its floor and its furniture.
What it does
ZeusXR Spatial Lab turns a classroom into a shared mixed-reality lab bench.
- The teacher anchors specimens in the real room. Photorealistic Gaussian Splatting captures are placed on the real floor or table through passthrough, and they stay where they were put — the anchors persist between sessions, so the specimen is still on the same table tomorrow.
- Everyone sees the same thing in the same place. The teacher opens a session and gets a four-digit code; each student joins with it. The headsets share the teacher's scanned room, so a piece anchored on the real table appears on that same real table for everyone.
- The class can handle it together. When the teacher moves or scales a specimen, every student sees it move. Any student can rotate it, and the whole class sees the rotation.
- You can get as close as you want. There is no proximity limit: students walk right up to the specimen and put their eyes on the detail, which is the thing a display case and a plastic model never allow.
- The class takes evidence away with it. A camera frame opens in the room; you move it with a pinch, resize it with both hands and shoot with a fingertip. The shots collect in a gallery inside the app — a student's own photograph of the specimen they just examined.
- Several specimens at once. Distant pieces render as a light hologram and resolve into the full capture as you approach, so a whole bench of specimens runs on the headset without dropping frames.
- The real room stays. Pieces are occluded by the actual walls, floor and ceiling, so a specimen behind the teacher's desk is behind the teacher's desk.
- Nothing is hidden behind a menu and nothing needs a controller. Turn your left palm up and the control panel is in your hand; undock it and leave it floating wherever you want it. Put your hand into a specimen and the points light up where you touch.
New in this competition window
ZeusXR Splats existed before September 24, 2026 as a single-user Gaussian Splatting viewer for Quest: a runtime splat renderer, pieces placed in the real room through passthrough, occlusion against the real walls, and persistent anchors. The repository history shows the first splat engine on July 21 and a passthrough build loading models from our portal tagged on August 4.
What we built during the competition window is the shared mixed-reality classroom mode. It is new, it is the reason the app is now a teaching tool instead of a viewer, and it has two halves:
- A multi-user mode (November 7 and 11). A host opens a session and receives a four-digit code. Guests join with it. The host's scanned room is shared through Meta's Space Sharing, backed by a shared spatial anchor, so a specimen anchored on the real table appears at that same physical point in every headset. Transforms sync at 15 Hz; guests can rotate a piece and everyone sees it rotate. Verified on two physical headsets — a Quest 3 and a Quest 3S — on November 11.
- A multi-specimen spatial mode (November 7 to 11). Several captures anchored at once, with a progressive level of detail that shows a light hologram at a distance and resolves the full capture as you approach; two-handed scaling; haptic feedback on touch; per-piece quality; a settings dial inside the spatial mode; and the removal of the proximity limit, so a user can walk right up to a specimen.
Also shipped in the window: walkable scenes with teleport (October 22), full spherical harmonics (November 8), a trained quality selector (November 9), in-app photo capture with its own gallery, and attribution credits for third-party captures.
How we built it
Unity, with the XR Interaction Toolkit and XR Hands on Meta's XR SDK. The splat renderer is our own: we ship a quality ladder per model and pick the level by how many pieces are visible, which is what lets several specimens share one frame. Measured on a Quest 3 running on battery — not tethered, where the GPU clock is higher — the spatial mode holds 60+ FPS in steady state with a specimen anchored in the room.
Mixed reality uses Meta's scene model for occlusion against real walls, floor and ceiling, and spatial anchors for placement that survives between sessions. The shared session combines Meta's Space Sharing with a shared spatial anchor as a fallback, over our own session server.
The content pipeline is ours end to end: video or photographs, camera poses with pycolmap, training with Brush, and a compressed level ladder the headset streams from our multi-tenant portal. A tabletop object trains in about five and a half minutes on a single RTX 4090, which is what makes a per-school catalogue realistic rather than theoretical.
Challenges we ran into
Getting two headsets to agree on where a thing is in a real room. Early builds put the specimen in the right place for the host and a metre off, or rotated, for the guest — which destroys the entire premise, because the whole point is that the class is looking at the same object. Combining Space Sharing with a shared anchor fixed it, confirmed on two physical headsets on November 11.
The second one was density. A classroom wants several specimens out at once, and a full-quality capture on its own can saturate the GPU. The progressive level of detail — a light hologram at a distance that resolves on approach — is what keeps a bench of specimens inside the frame budget.
How to test it
The app installs as "ZeusXR Splats". Everything below is done with bare hands. No controller is needed at any point — please do not pair one.
Part one — one headset
- Open the app. The system asks for spatial data permission — press Allow. (The app still runs if you decline.)
- Room scan. If your headset has not scanned this room yet, a card offers Start scan or Skip. Start scan opens Meta's Space Setup: look slowly at the walls, floor and furniture, about 30 to 60 seconds. If the room is already scanned, this step does not appear.
- Tutorial. Six cards — scanning, the palm menu, pinning the menu, picking a model, taking a photo, inviting people. Press Next with a fingertip, and Start on the last one.
- The first specimen appears about a metre in front of you and resolves out of a cloud of light over roughly six seconds.
- Turn your left palm up. The control bar appears over your palm; press its buttons with the index finger of your other hand. Lower your palm and it goes away. To leave the bar floating in the room, pinch the small handle underneath it and release it wherever you want. Every panel in the app moves the same way.
The bar reads, left to right: the logo and the model name, then Scan, Recenter, Camera, Gallery, Like, Invite, and Exit. The Scan icon carries a green tick once your room has been scanned.
- Pick another specimen. Touch a thumbnail in the row above the bar, or use the arrows beside the model name. The new one replaces the old one in the same place. Thumbnails marked SOON are placeholders.
- Rotate it: pinch in the air with one hand and move your hand sideways. Scale it: pinch with both hands and move them apart or together. Turning both hands rotates it too.
- Touch it. Put your hand into the specimen: the points light up where you touch and you feel a soft buzz.
- Move it. Press Recenter and a ring of light appears on your real floor. Pinch in the air and move your hand — the specimen follows you, near or far, left or right, up or down. Done anchors it there and Reset brings it back in front of you. It stays anchored to the room and will be in the same place the next time you open the app.
- Walk right up to it. There is no proximity limit: put your eye on the detail. Your real walls and furniture occlude it.
- Take a photo. Press Camera and a frame opens in front of you. Move the frame by pinching it, resize it with both hands, and press the centre button to shoot; X closes the camera. Then press Gallery, next to the camera, to look at your shots and swipe through them with a finger — it stays dimmed until you have taken one. Photos stay inside the app.
Part two — the shared classroom (two headsets in the same room)
This is the part the whole project is for. Steps 1 to 11 work on their own, but the shared room is the reason the app exists, and we would ask you to try it with a colleague.
- On the first headset, press Invite. A four-digit code appears.
- On the second headset, press Invite and then Join, and type the code with your finger. You will see Connecting, then Look around — move your head slowly so the two headsets agree on the room — and then Connected · Enjoy the visit.
- The specimen is now in the same physical place for both of you. Walk around it together, from opposite sides. When one of you rotates it, the other sees it rotate.
Both headsets need Enhanced spatial services enabled, an internet connection, the app installed from this release channel, and a different Meta account on each one.
- Leave with Exit at the right end of the bar, then Exit app.
What's next
Our own capture studio. We run a chroma studio in Chile and are capturing the first specimens ourselves, from macro subjects upward — our macro capture of a circuit board is the proof of concept for the next step: a physical cradle that turns a Quest 3 into a virtual microscope, so a school can look at samples it could never afford to buy.
Beyond that: teacher tools for assessment, AI narration and context for each specimen, GLB import, bigger classes, and a Vision Pro build.