Inspiration
Ten years ago, my brother and I launched Wonderstructs, a kit for making wooden rolling ball sculptures that attach to the wall. The many kinetic rolling ball sculptures by artists like Shab Levy and George Rhoads inspired us.
Ever since we got the Meta Quest headsets, we thought how fun it would be to make this kind of sculpture in virtual or mixed reality. In August 2026, we released Wonderstructs on the Meta store in Early Access.
What it does
We'd always planned on supporting hands only, but we hadn't thought about a more compact mode (airplane friendly). The 2026 contest inspired us to try it out—and it actually is just as fun as the room scale version! The code enabled us to shrink the sculptures to desktop size and also allowed us to make them two stories tall, which also turned out to be fun!
Challenges we ran into
Manipulating sculptures with hands at a small scale presented some interesting challenges. Fingers got in the way of picking up and painting the pieces, so we introduced tools that you hold in your hand to make the positioning and painting more precise.
Another challenge was that the cursor ray and pointer method for clicking buttons often interfered with the parts, so when using hands, we made the UI respond only to finger presses. When holding controllers, the UI now shows a cursor on the button indicating when you can press it with the trigger.
Accomplishments we're proud of
We're very proud of the tools we introduced in seated mode. Tweezers appear as you pinch your finger and thumb to indicate that the app recognizes the pinch gesture and enables more precision when picking up and moving parts. Similarly, when painting, an eyedropper appears between your finger and thumb and fills with paint as you squeeze it to paint the parts.
What we learned
Hand tracking is hard! Controllers have a physical button. Without that, you need visual indicators and sounds to know your gestures have been recognized.
Smaller scales are also a challenge. Everything must be always within arm's reach, and interactions must be more precise. For example, when choosing a note on the musical rail, we enlarged the note selector in seated mode so you could choose the precise note. The note wheel enlarges as you move closer to it with the controller or your hand.
What's next for Wonderstructs
We'll continue to add polish and fix bugs until we reach 1.0. And we still want to add multiplayer and more parts to choose from.
Built With
- godot