Inspiration

Every December we wrap gifts and every December it goes the same way: too much paper or too little, crooked cuts, bulky ends, a second try. Video tutorials can't see your gift or your paper. Mixed reality can: it sees your table, your hands and the box in front of you. We wanted a headset to be genuinely useful for a ten-minute chore everyone has.

What it does

  • Measures a real gift with your hands. Touch three top corners and WrapFit works out length, width and height, then shows a frame of light on the box so you can check it.
  • Draws the sheet to cut, life size. The exact rectangle of paper the gift needs appears on your table, with its size, so you cut once and waste nothing.
  • Guides every fold on real paper. A ghost of the flap shows each movement, a dashed line shows the crease, and a highlighted strip shows where to put the tape. You do it, press Done, and the next step appears.
  • Keeps up when the gift moves. Touch two corners and the guide lines up with the gift again.
  • Practice mode. Wrap a virtual book, shoebox or cube with your bare hands — pick up flaps, fold them, pull and tear tape — before touching real paper. It also works for a virtual copy of the gift you just measured.
  • Hands only, seated, works on any table, a full wrap in under ten minutes.

How we built it

Unity 6 with URP, Meta XR SDK v207 (Core, Interaction SDK, MR Utility Kit), OpenXR, passthrough and hand tracking on Quest 3. MRUK finds the table, with a pinch fallback when the room has no scene data. The wrap itself is pure C#: from a box size, a planner computes the sheet size and an ordered list of folds and taping steps, the same plan driving both the virtual paper simulation and the guide lines on real paper. The paper is a set of hinged panels re-meshed each step, with tucked corners. The measurement turns three fingertip points and the known table height into a box pose, rounded to half a centimetre. The project has 177 automated tests for the geometry.

Challenges we ran into

  • Hand-tracking error is about a centimetre, so measuring needed careful design: marking a corner with a pinch of the other hand keeps the touching finger still.
  • Real paper and a real gift move while you work; we added a two-corner re-alignment instead of asking people to keep still.
  • Making folds understandable without words: the ghost flap and a single dashed crease per step tested better than showing every line at once.

Accomplishments that we're proud of

A headset that helps with a physical task from start to finish — measure, cut, fold, tape — with nothing but your hands.

What we learned

In mixed reality the best overlay is the smallest one: one line, one ghost, one button.

What's next

  • Recognise the gift with the passthrough camera, so it is tracked without touching corners.
  • More wraps: Japanese diagonal wrap for any box, bottles, cylinders.
  • Bows and ribbons guided the same way; voice and gaze for the Done step when both hands are busy.
  • A history of wrapped gifts and a seasonal gift list.

Built With

  • c#
  • hand-tracking
  • interaction-sdk
  • meta-xr-sdk
  • mr-utility-kit
  • openxr
  • passthrough
  • unity
Share this project:

Updates

Submission history