Inspiration
Buying a home is one of the biggest decisions of a lifetime, and yet you usually make it from a handful of photos, a flat floor plan and a short visit, often with someone else's furniture in the rooms. There was no tool that let you step into the home you are about to buy, whenever you want, and see how your life would fit in it.
We wanted to change that. FloorPlay gives you a preview of the home before you buy it. You can hold it on your desk as a small model, walk through its rooms at real scale, place your own furniture and see the light at different hours. Before signing anything, you already know what it feels like to live there.
What it does
FloorPlay turns a home's floor plan into a 1:20 tabletop model that you use seated and with your hands only, from start to finish.
- Load a home. Pick a demo apartment or load your own floor plan as a JSON file from the start screen. Walls, doors and windows are built from it.
- Hold and turn it. Pinch with both hands to rotate and zoom the model on your desk.
- Furnish it. Pinch a piece from the catalog (or from your own furniture list), drop it in a room, and turn it by 90°. Pieces snap to walls, and the app warns you when a piece overlaps another or blocks a door. From the start screen you can change the size of any catalog piece to match the furniture you really own.
- Go inside. Jump to a viewpoint at real scale with a gentle fade, then walk through the rooms with a two-hand "row" gesture: close both hands into fists and pull them back together, like a rowing stroke. Walls block you, doors gently guide you through, and a comfort vignette darkens the edges while you move.
- See the light. The sun is placed from the home's location, date and time, so you can check where the light falls.
- Present it (agent). Add info points to rooms and stage the home in one gesture. A head-direction interest map shows where visitors looked.
- Live in it (tenant and owner). Pin an issue to the exact spot in the home, choose a category and an urgency, and follow it from red → orange → green, with its full history and a move-in / move-out report.
- Comfortable for everyone. Menu buttons sit by the right hand by default and can move to the left. High-contrast theme and large text are built in. Panels open 0.5–0.8 m away, near the centre of view.
- Never lose your place. Everything saves automatically: take the headset off, put it back on or reload the page, and you are back where you were.
How we built it
- Immersive Web SDK (IWSDK) with TypeScript and Vite, running in the browser over WebXR. Three.js comes only through IWSDK.
- An entity-component-system architecture. Each system owns one job (house builder, miniature, furniture, viewpoints, walk, sun, issues, roles, persistence, accessibility).
- All the hard parts are pure logic with no rendering imports, and are covered by thousands of Vitest unit tests. That includes wall openings, snapping and collisions, the row gesture, walking collisions, sun position and the issue state machine.
- A single serializable store holds the whole app state (home, role, layout, issues, preferences). It is what we save, restore and test against.
- We tested every feature in IWER, the IWSDK browser emulator, through scripted QA scenarios. Then we tuned it on a Meta Quest (for example, walking speed and gesture thresholds).
- Content is CC0 or made by us; homes and the furniture catalog are plain JSON files described by JSON Schemas.
The model sits at a scale of $$s = 1/20$$. When you walk inside it, we do not shrink you: we scale the model up by $$1/s = 20$$ around your head and move the model under you. That way your eye distance, reach and panel distances stay correct.
Challenges we ran into
- Hands-only, end to end. Pinch, grab, the two-hand model gesture and the walking gesture all share the same two hands. We built a priority system for who "owns" a pinch, and a short lock after each pinch, so the gestures don't trigger each other.
- Walking without nausea, seated. No thumbstick, no teleport. We designed a gesture-driven walk with smooth speed decay and a comfort vignette. We also made doorways easy to pass: a thin body and doors that gently guide you to their centre.
- The emulator is not the headset. Things that looked right on the desktop felt different on the Quest: panel distance, walking speed, buttons that overlapped. We moved panels closer, restyled the buttons and re-tuned speed after real tests.
- Performance on a standalone headset. A strict budget (≤ 100 draw calls, ≤ 150k triangles, sun-only shadows) to stay at 60–72 fps.
- Real floor plans are messy. Turning a real PDF plan into clean data meant room polygons and wall centre lines had to agree exactly, so that every door sits on the shared edge of the two rooms it connects.
Accomplishments that we're proud of
- A complete loop for three kinds of people, buyer, agent and tenant/owner, in one small model, with no controller ever required.
- Walking inside a model you hold, driven only by a natural hand gesture.
- Issues anchored to the exact spot in the home, with a clear colour-coded lifecycle and a move-in / move-out report.
- Accessibility from day one: one-handed use on either hand, high contrast, large text.
- A large automated test suite on the pure logic, so we could change behaviour quickly in the last days without breaking things.
What we learned
- Hands-first design is mostly about what not to trigger: rejecting false gestures matters as much as recognising real ones.
- Comfort numbers (distances, speeds, sizes) must be tuned on the real device; an emulator only gets you close.
- Keeping logic pure and state in one store makes save/resume, testing and debugging dramatically easier.
- Less is more in VR UI: we removed features (a tape measure, door-fit labels) to keep the experience clear and focused.
What's next for FloorPlay
- Import from a PDF or image floor plan directly, instead of a JSON file.
- Real furniture models for every catalog piece, and scanning your own furniture with the headset.
- Shared sessions, so an agent and a buyer, or a tenant and an owner, can look at the same model together.
- Exportable reports of issues and of the move-in / move-out record for tenants and owners.
Built With
- ajv
- css3
- ecs
- github-actions
- hand-tracking
- html5
- immersive-web-sdk
- iwer
- javascript
- json-schema
- meta-quest
- mixed-reality
- node.js
- quest-browser
- three.js
- typescript
- uikit
- vite
- vitest
- webxr