Inspiration
Most VR creation tools still rely on controllers and menus. We wanted to strip that away entirely — what if your hands were the only tool you needed? VoxSculpt was born from the idea that sculpting in VR should feel as natural as shaping clay with your bare hands.
What it does
VoxSculpt lets you sculpt 3D voxel structures in Meta Quest using only your hands. Pinch to place voxels, grab to move them, and shape entire structures without touching a single controller or menu. Real-time hand tracking drives every interaction.
How we built it
Built with WebXR and TypeScript on Meta Quest. Hand tracking is handled entirely through the WebXR Hand Input API — no controller fallback. Voxel placement and manipulation logic runs in real time responding directly to hand pose and gesture detection.
Challenges we ran into
Hand tracking precision at the voxel level was the core challenge. Distinguishing intentional placement gestures from natural hand movement required careful threshold tuning. Keeping performance smooth on-device while rendering dynamic voxel grids in real time was a constant balancing act.
Accomplishments that we're proud of
A fully hands-first VR sculpting experience with zero controller dependency. Every interaction — place, move, delete, sculpt — works through hand tracking alone. It passes the seated test, the bus stop test, and the take it away test from Meta's own design guidelines.
What we learned
Designing for hands-first is fundamentally different from designing for controllers. Gestures must be deliberate but forgiving. The user's hands are always visible — every interaction has to feel earned and intentional, not accidental.
What's next for VOXSCULPT
Multi-hand collaborative sculpting, export to standard 3D formats, and a gesture-based palette system for textures and colors — all without ever picking up a controller.
Built With
- api
- hand
- html
- input
- javascript
- meta
- quest
- typescript
- webxr
