Inspiration

Most people would love to give a good massage to their partner or a family member, but videos are hard to follow: you look at a screen, then at the person, and you lose your place. We wanted the instructions to live exactly where the work happens: on the person's body.

What it does

BySCM Massage is a mixed reality massage coach for beginners on Meta Quest 3 and 3S.

  • Pick a body part (back, arms, legs, hands or feet), a style and a length (about 5 to 15 minutes) on a small 3D mannequin.
  • With passthrough, place a simple outline over the real person lying down and fit it by pinching a few handles.
  • For each step the app highlights on the real person the zone to work on and marks the areas to avoid (spine, kidneys, back of the knee).
  • Right next to where you work, a small 3D model on a massage table shows realistic guide hands doing the movement: long strokes, kneading, thumb circles, tapping. The part of the hand that should press glows, so you always have a clear reference without anything covering the person.
  • A voice reads each step, relaxing instrumental music plays, a timer keeps the rhythm and the routine moves on by itself, so your hands stay on the person.

Everything works with hand tracking only: pinch to adjust, touch the floating panel, and look at your palm to open a wrist menu. No controllers needed.

How we built it

A WebXR app built with three.js and Meta's Immersive Web SDK (IWSDK) that runs directly in the Meta Quest Browser, no install. It uses an immersive-ar (passthrough) session with hand tracking, a rigged and skinned hand model driven by a set of hand poses we authored in a custom pose editor, and a mannequin model rigged and optimized in Blender. The massage steps are plain data files, so new routines are easy to add. Music and voice were generated locally on our own PC. The interface is in English (Spanish also available).

Challenges

Making the drawn zones sit believably on a real body, adapted to the outline the user fitted, and making the guide hands on the side model readable at a glance: they tilt so only the contact part touches the skin and two hands never overlap. We first placed the guide hands directly on the person, but they covered the body you are working on, so we moved them to the side model. Keeping the whole flow usable with oily hands was another one, which is why the routine advances on its own.

What's next

Front-of-body routines, neck and face, more narration, and saving a body fit per person.

BySCM Massage offers general wellness guidance for beginners; it is not medical advice.

Try it: https://epiconde.github.io/xr-massage-guide/ (open in the Meta Quest Browser on Quest 3/3S)

Built With

Share this project:

Updates

Submission history