Inspiration

I have served on a sound team for over 12 years, and the hardest part has never been the equipment. It is finding people willing to try. Again and again I hear the same thing: "I'm not technical enough."

Yet most of the job can be learned: unpacking cases, placing mics, running the snake, plugging the right cable into the right socket, powering up in order, then packing it all away. The trouble is that the only place to learn it is a live setup, under time pressure, with everyone watching.

SoundTeam XR gives people a private place to find out they can do it.

What it does

  • Set up a real rig. 15 short guided lessons take you from empty cases to a full band: console, snake, stage box, mics, DI boxes, wedges, then power-up in the right order.
  • Tear it down again. Power off in order, unplug and pack the cases.
  • Practise on your own. Build the whole stage untimed, or race the clock.
  • Fix it when it breaks. 20 soundcheck faults, such as a silent keyboard or a crackling mic. Ask the band to play, trace the signal and fix it.
  • A voiced coach talks you through every step.

Everything works with your eyes and a pinch: no controllers, seated or standing.

How I built it

The app is built with Meta's Immersive Web SDK (IWSDK) on WebXR, in TypeScript. Under the visuals is a signal-flow model of the rig: every cable, socket and switch is simulated, so a wrong connection behaves as it does on a real stage.

I built it with Claude Code as my coding partner. The coach's 192 voice lines are generated with a local text-to-speech model.

Challenges

  • A narrow view. Meta VR Glasses show about 37° to each side, so every panel and piece of gear is placed by measured angle.
  • Plugging cables with your eyes. Stage box sockets are 5 cm apart, too fine for gaze, so a patch card shows them as large numbered buttons.
  • No headset to hand. Everything was built and tested in the IWSDK emulator.

What I learned

The biggest lesson was how much my AI coding partner needed correcting. It could write the code and pass its own checks, and still get the experience wrong. Its audit said every socket could be reached; I couldn't find the snake socket, because it was hidden behind the desk. It drew a 0 mark a newcomer would never recognise, and it had never tried the app sitting down.

None of that shows up in a test. It shows up when someone who knows the job plays it as a beginner would. The AI made me fast; twelve years on a sound team told me what was wrong.

What's next

  • Use better real audio assets
  • Test with real volunteers on real headsets.
  • More venues and realistic gear from brands.
  • Your own venue: practise on your team's real room and rig.
  • Mentor mode: a team leader joins to coach a newcomer live.

Built With

Share this project:

Updates

Submission history