Inspiration

Height is the sensation VR delivers most physically, especially the feeling that you might fall. In RULE MAKER, you sit on a narrow platform jutting out from a skyscraper roof, hanging from just four wires.

On top of that tension, we layered a battle of wits. Before each round, you secretly talk with an AI judge by voice and turn your ideas into rule cards, such as "Hearts score double." You play them to beat your opponent's score. Every round you lose snaps one wire. Lose three, and the platform falls.

What we learned

The mind game works. A colleague who playtested it called it a true game of deduction, and "exactly my kind of game."

Keep the fear. We removed our gentle "Comfort" fall. The default is now a real free fall from 150 m:

$$ t = \sqrt{\frac{2h}{g}} \approx 5.5\text{ s}, \qquad v = \sqrt{2gh} \approx 54\text{ m/s} $$

In exchange, we never force camera rotation, the platform only slides at 0.5–1.5 Hz, and acceleration never exceeds \( g \).

Let the LLM handle words, never math. Each AI rule becomes a structured rule (an AST), and the host's engine computes scores and the winner from it deterministically.

How we built it

  • Unity 6 + URP on Meta Quest (OpenXR). Hand tracking is the main input: pinch a rule card and drop it into the slot.
  • The AI judge runs on OpenAI's realtime voice model. The API key lives only in a relay server on Cloudflare Workers.
  • Online matches use peer-to-peer networking through Epic Online Services.
  • The rules engine is pure C#, verified by hundreds of automated tests.
  • The opening turns your own room, in mixed reality, into an elevator.
  • About 960 commits in four weeks, built alongside AI coding agents.

Challenges

Rules that only work with voice AI. "You can talk to it" isn't enough; buttons could do that. Our answer: players create the rules themselves by talking them through with the AI.

Combining a death game with voice AI. We made the consultation a secret strategy meeting your opponent can't hear, so you never know their rules until they hit the table.

The AI didn't always build the rules we meant. So we built a dedicated debugging web app that runs the game's rule engine, sends batches of requests to the AI, and records the conversations.

A city that sells the height at 90 Hz. We used interior mapping for the windows: convincing rooms behind the glass, without real geometry.

What's next

A practice opponent that feels human. We plan to drive the practice opponent with an LLM so it bluffs and reacts like a real person.

Rules beyond the cards. We will extend the system so rules can cover more than the playing cards.

How to test

No second player? On the rooftop start panel, choose "Play the practice opponent" for a full solo match. The AI judge needs a microphone and an internet connection.

Content note: the opening shows another player's fatal fall, with blood. After you have seen it once, a "Hold to skip" button lets you skip it.

Built With

  • .net
  • android
  • ar-foundation
  • asp.net-core
  • c#
  • cloudflare-workers
  • epic-online-services
  • gpt-live
  • hlsl
  • il2cpp
  • meta-openxr
  • meta-quest
  • nunit
  • openai-api
  • openxr
  • playeveryware-eos-plugin
  • python
  • typescript
  • unity
  • unity-input-system
  • universal-render-pipeline
  • wrangler
  • xr-hands
  • xr-interaction-toolkit
Share this project:

Updates

Submission history