-
-
H0lografic Gaussian Workshop: sculpt and paint Gaussian splats with your bare hands.
-
A tracked digital hand interacts with a holographic object inside a real café, connecting natural gestures with virtual content.
-
Holograms in Everyday Spaces An anime-style hologram shares the user’s physical space, blending digital content with an everyday environment
-
Spatial Editing Controls Adjusting a floating digital object through an in-space menu for animation, positioning, and behavior.
-
Multiple holographic cards arranged above a real table, bringing a digital scene into the surrounding physical space.
-
Customizable Digital Hands controls let users customize digital hands, including mesh, colors, transparency, and interaction settings
-
Key art: a classical bust as a Gaussian splat, held by holographic hands.
-
Mixed reality 3D splat studio for Meta Quest 3 and 3S.
-
H0lografic Gaussian Workshop banner.
-
H0lografic Gaussian Workshop, wide banner.
-
A Gaussian splat head, sculpted point by point.
Inspiration
It all started on my Apple Vision Pro. I built a full "gaussian splat" spatial editor so I could finally place them in my room, grab them with my hands, and see them where they belong. On Vision Pro that editor is complete and fully functional: the whole workshop, every tool, running at full density on the M2.
When this competition opened, I set myself the real question: how much of that workshop can honestly live on a Quest 3?
What it does
H0lografic Gaussian Workshop puts Gaussian-splat holograms in your real room and lets you work on them with your hands, at real scale. It is a curated gallery of my own splats. Pick a piece, and the workshop checks it fits the headset before it ever appears in your room.
- Grab, turn, scale a hologram with your hands, with filtered motion so it never shakes; controllers remain only as a fallback.
- Sculpt: push and shape the splat itself, like clay made of light.
- Paint: paint directly onto the hologram in space.
- FX: apply live effects to a piece while it floats in front of you.
- Transform: position, rotate and scale with precision when freehand is not enough.
How we built it
Native Android with Kotlin and the Meta Spatial SDK (entity-component system, Compose panels for the interface), OpenGL ES for rendering, and a custom SPZ loader (SPZ v3) written for this project, because the SDK's built-in splat support is a black box I could not tune. Hand tracking is the primary input from the first frame to the last.
Challenges we ran into
The Quest 3 is not a Vision Pro. The full editor, moved as-is, did not fit. A single dense splat could drag the frame rate down on its own. The bottleneck was per-item cost: splat count, overdraw, sorting.
So the port became an exercise in honest engineering. Every piece in the gallery is built to a per-item splat budget: the highest density that still holds 72 fps while you grab and scale it, with a couple of seconds of load time. And I made a deliberate choice about tools. For performance reasons, the Quest build keeps the four tools that define the workshop (Sculpt, Paint, FX and Transform) instead of shipping the complete Vision Pro toolset and letting it stutter. A smaller workshop that works, over a complete one that doesn't.
The Quest version is not the full workshop, and I won't pretend otherwise. It is the same editor, tuned to the hardware it runs on.
What's next
The full toolset, returning as the hardware grows. This editor is built with a vision toward the Meta VR Glasses (spring 2027): more memory, a far stronger processor, the same gaze-and-pinch language. When they arrive, the budget rises and the workshop opens back up. No redesign, just headroom. Also I think this app will work way better in the upcoming Meta VR Glasses 😏
- Uploading your own SPZ files straight from inside the app.
- A persistent floor anchor, so a hologram you place is still there tomorrow.
Built With
- android
- android-studio
- gaussian-splatting
- gradle
- jetpack-compose
- kotlin
- meta-quest-3
- meta-spatial-sdk
- mixed-reality
- opengl-es
- passthrough
- spz
