Inspiration

The Nufflers come from our animation project: a series about tiny, mischievous creatures living in a world with its own semi-defined rules. They are small, curious and mostly up to no good. Their world felt like a natural fit for VR, where you can stand among them instead of watching them on a screen. With this game we tried to bring a piece of that world into a fast-paced VR experience. The Nufflers invade your living room, and you have to exterminate them in check.

What it does

The Nufflers is a Meta Quest game set in a cosy living room that comes under attack, wave after wave, by Nufflers:

  • Chasers close in and throw pebbles at you.
  • Carriers sneak around dropping LEGO bricks that hurt to step on.
  • Flyers buzz around your head.

You fight back with your whole body:

  • Kick and stomp: charge a kick or a stomp, or with hand tracking, karate-chop with a flat hand. The direction of the chop decides where the foot lands.
  • Grab and throw: pick up Nufflers, shoes, LEGO bricks and the fly swatter and hurl them. With hand tracking, an open palm lifts objects from a distance and a fist pulls them into your hand.
  • Swat: use the fly swatter on the flyers.
  • Eat: take a bite out of a Nuffler to restore health.

You can play with tracked hands or controllers, and standing or seated. In seated mode you see the game from standing height and can reach Nufflers without bending down. Playing with hands starts with a short tutorial for moving with thumb microgestures, turning, karate chops and grabbing. Meanwhile, the TV in the room plays an episode of the Nufflers animation.

How we built it

  • Engine: Unity 6 with URP and OpenXR, using Meta's XR Core and Interaction SDKs for hand tracking, microgesture locomotion and teleporting.
  • Art and animation: Maya and Blender. We reused characters and assets from the animation project, and added stock and CC0 assets for the room and props. Some assets were generated with the help of AI.
  • Gameplay code: written in C#: ragdolls for the Nufflers, kicking and stomping driven by leg IK, gesture recognition for chops, fists and open palms, and throwing physics.
  • Testing: constantly on a Meta Quest 3, to tune gestures and keep the game running at the headset's full 72 FPS.

Challenges we ran into

  • Tiny creatures: in the lore, Nufflers are really small. That made it hard to interact with them and to keep them visible enough at your feet in a fast game. We tuned their size, made them come closer when you play with hands, and gave the player generous ways to reach them: distance grab, a seated mode, and kicks and stomps that snap onto a nearby Nuffler.
  • Hand gestures in a fast game: hand tracking suits slower-paced experiences. Fast swings, hands crossing and hands leaving the field of view all make tracking unreliable.
  • Too few distinct gestures: only a limited number of hand gestures don't overlap. Meta's locomotion already uses thumb taps and swipes, and grabbing, throwing, kicking and stomping all had to fit around them without triggering each other. We tried pinches, double taps, pointing and fist punches before settling on karate chops for kicks and stomps, and an open palm followed by a fist for grabbing.

Accomplishments that we're proud of

  • The whole game works with hands alone, from the menus to the tutorial to the last wave, while controllers stay fully supported.
  • The karate chop: it fits the cartoon world, and its direction decides where you kick or stomp.
  • Bringing characters from our animation into a playable world, with the show playing on the TV in the room.
  • Making room-scale and seated play feel good.

What we learned

  • Designing for hand tracking is very different from designing for controllers: every gesture needs clear rules about when it counts and what it must never be confused with.
  • Small details matter a lot in VR. Throws that leave the hand mid-swing, objects that don't bounce off your own body, and menus that follow your eyes all make a big difference.
  • Testing on the headset early and often beats any amount of testing in the editor.

What's next for The Nufflers

We would like to keep developing The Nufflers:

  • New gameplay mechanics and new environments from their world, beyond the living room.
  • An option to play as a Nuffler, seeing the world from their tiny point of view.

Built With

Share this project:

Updates

Submission history