Inspiration
I had originally asked myself, what hasn't been done before on the Quest platform involving hand interactions? I had a few ideas, some of which were honestly easier to implement than this, but I decided to commit to the marionette fighting concept, because it seemed the most novel and fun.
What it does
On the Ropes is a physics based 1v1 puppet fighting game played entirely with your hands and intended for passthrough, with puppets colliding accurately with everything around you. Hold a marionette bar, or have the strings fall from your own fingers to punch, kick, block and parry your opponents. And when your arm gets tired, you can control your puppet remotely while relaxing your arms.
As puppets take damage their strings start to snap and their limbs go floppy, and that happens to you too. A knocked out puppet has every string cut and drops onto your real floor or desk.
Story Mode has a tutorial hosted by a posh theatre commentator, followed by five unique fighters who each have their own gimmick.
Gauntlet Mode has you fight for as long as you can, choosing upgrades along the way and earning 'splinters' to spend in the shop after a run, to permanently upgrade your puppet.
Sandbox Mode lets you practice your moves, play as bosses you've already defeated, and fully explore the mechanics of the game.
Multiplayer Mode lets you play with your friends, or with a random player online (if one can't be found, you'll fight an intelligent bot that behaves just like a player)
Both story and gauntlet mode reward the player with cosmetics to change the look of your puppet, with things such as different wood materials, clothing items, and even emotes that you can perform during fights.
How I built it
I built it solo in Unity 6, starting on 6 October 2026, using:
- Meta Interaction SDK for hand tracking, poke, pinch and grab, plus gaze: look at a fighter’s portrait on the story select and he reacts to you.
- Passthrough and the Mixed Reality Utility Kit, with the Depth API (via MRUK Environment Raycasting) for real-surface collisions.
- Meta XR Audio SDK for spatial sound.
- The puppets are physics ragdolls on simulated strings.
Challenges I ran into
Fingers were the biggest problem. When you move one finger the ones next to it move as well, so the game kept throwing the wrong punch. I fixed it by comparing how far each finger moved from its own resting position and only firing the one that moved the most.
My first headset test also showed that pure physics didn't feel like a fighting game. Punches flew all over the place. Adding aim assist so attacks actually go towards the opponent was what made it fun.
Fast string grabs kept missing as well, so I track the path your fingers take instead of just where they are on one frame. And I found that relying solely on room scans had some inconsistencies and pitfalls, so I instead opted for a hybrid system, using some roomscan colliders such as walls and floors, empty shells for things like tables, and live depth (Meta Depth API via MRUK Environment Raycasting) for everything else.
What I'm proud of
The level of polish and detail I was able to add in a short space of time. For example:
- Sound effects for every single interaction, including running your finger through the dangling title letters, different sounds based on how hard you poke a button, many different sounds for the movement and collision of the puppets.
- The music using the plucking of strings and knocking of wood and changing slightly based on which menu screen you're on, even changing slightly between pass and non passthrough.
- The changing facial expressions of the puppets.
- The announcer reacting to different events during fights.
- Particle effects on hits, falling to the floor, and even dust under the spotlight.
What I learned
For my first game, I didn't use any Meta platform tools, doing it all myself. For this game however, I realised how much quicker and easier the process is when using the platform tools meta provides, and there's no going back for me now, I will be using Building Blocks on every project. I also learnt that you need to get creative when it comes to hand interactions, since the player environment wont always be ideal. This meant aim assist, fallbacks for lack of room scans or poor lighting, and planning for fingers being hidden from the cameras.
What's next for On the Ropes
I'm planning to release On the Ropes on the Meta Horizon Store, with a target launch of early 2027. After that I'd like to add more story fighters, more cosmetics, and more features. I’ve also kept essential UI within a narrow field of view so it’s ready for Meta’s upcoming glasses.
