Gesture Clash

Cover
Logo
Screenshot1
Screenshot2

Inspiration

Racket Club, Divine Duel, Hogwarts Legacy etc.

What it does

Gesture Clash is a multiplayer mixed reality dueling game where players face off against friends, other players, or AI bots through a shared portal. Players cast fireballs and spells using intuitive hand gestures tracked by Meta Quest hand tracking. The game features synchronized Meta Avatars, proximity-based voice chat, and real-time multiplayer combat that works seamlessly across different physical spaces.

How I built it

Using Unity as our core game engine. For multiplayer functionality, I integrated Normcore (Normal Realtime) to handle real-time synchronization of player actions, spell projectiles, proximity voice chat and simple match making (which automatically places players into the first available room)

I leveraged several Meta SDKs to create an immersive experience:

Meta Avatars SDK for synchronized player representations
Hand Tracking & Gestures SDK to detect and interpret natural hand movements for spell casting
Occlusion SDK to blend virtual content with the real world
Platform SDK for username integration

For the multiplayer portal I created a stencil shader effect with occlusion and positioned opposite player/bot inside the portal.

Challenges I ran into

I discovered that complex gestures like horns or victory signs would have felt less intuitive and more awkward to execute repeatedly during gameplay. This was once again another less is more moment - focusing on a few well-polished, ergonomic interactions created a better user experience than many complex gestures that might look cool but don't feel good to use.

Accomplishments that I'm proud of

Meta Avatars with hand tracking and gestures across multiplayer sessions to ensure that each player's gestures and movements are accurately represented to other players in real-time. The result is a seamless experience where players can see each other's spell-casting gestures and reactions naturally.

What I learned

Anchoring content to walls/other objects or using a room scan isn't ideal for smaller rooms and outdoor environments at least for this specific use case.