It's a blob!

It's a game!

It's... GUII THE SUPERINTELLIGENT GOO!

https://guii.world


Inspiration

My inspirations, as usual, are Ed Catmull of Pixar and Walt Disney, both of whom strove to use emerging technology to tell real stories and create characters with heart. I was also inspired by Meta releasing WebGPU last week (11/12/26), and all the possibilities for real-time simulation and performant rendering that unlocked. Like Catmull and Disney, I wanted to turn that technology into likable, comic characters in a never-before-possible experience.

What it does

This is a hand-eye physics puzzle game in mixed reality starring the world's most famous gelatinous genius! Get to know and interact with Guii and the Agent with hands, voice and drawings while traversing increasingly challenging environmental puzzles. Created by James C. Kane (https://jamesckane.com), winner of the 2025 Meta Start Developer Competition, and powered by WebXR, WebGPU and Meta Muse Spark.

How we built it

I used a mixture of frontier models to code the game in WebGPU and WebXR, primarily testing on desktop with the Immersive Web Emulator, then on Quest 3 for final QA for performance profiling. Because I'm focused on using AI for novel gameplay, I also used the Meta Muse Spark API to transcribe and interpret speech input. For example, the player must decide whether to reveal the Boss' evil plan when directly asked, and Muse Spark parses player speech to determine whether they're being honest. I also trained a small custom neural net for a drawing detection mechanic. To record lifelike performances as 3D characters for the game, I added live face & eye tracking w/ Quest Pro to single-camera body tracking in the open source RGBMocap, plus ElevenLabs voice changer API, all synced to deliver authentic line reads as .vrm 3D avatar characters.

Challenges we ran into

Due to the nature of the game, optimizing performance to meet requirements was a challenge, especially with the experimental nature of the new WebGPU API – turns out some standard WebXR features I was trying and failing to implement, like depth-sensing, just aren't available yet in WebGPU! Just as soon as I could claw back a few milliseconds from the CPU or GPU clocks, I was spending it on another new feature or piece of polish. But by balancing creative and technical concerns and making some design concessions, I was able to deliver a performant, original, fun game.

Accomplishments that we're proud of

Overall, I wrote and performed 60+ lines of dialog for the 3-character cast inside 10-page, comic book-length script – even building the mocap/facecap setup myself – while developing and designing the game solo. I'm proud of bringing a unique story and character with a full beginning, middle and end in a digestible experience that conforms to the contest parameters of seated, hands-oriented games!

Also, I love the original soundtrack by GUIDEBOOK – real music written & recorded by humans! Each puzzle has a unique track, Guii has two hero themes, and the villain and boss battle have their own songs, all of which were crafted by the great Ben Wade of GUIDEBOOK. Listen here:

What we learned

I learned you can push further than ever as a generalist, creative solo developer, and I learned that the browser is now the best possible development and distribution platform for immersive experiences.

What's next for Guii: The Superintelligent Goo

I would also like to explore room-scale or home-scale experiences for Guii (and friends) that can take advantage of computer vision and scene understanding to a greater degree than seated experiences can. I would also like to build in more hidden and natural interactions with Guii (though there are several already, such as just waving at him) to make the experience as lifelike as possible. Overall I hope to continue development with more levels, features, content and even monetization.

Built With

  • metamusespark
  • webgpu
  • webxr
Share this project:

Updates

Submission history