-
-
Dragging a ripple of bioluminescence through a mixed reality koi pond
-
Controlling a gust of Cherry Blossoms with my hands in Mixed Reality
-
Pulling a ball of water out of the pond in the Mixed Reality Koi Pond
-
Drawing the bounds of the Koi Pond in Mixed Reality
-
The results of drawing the pond
-
A similar view of controlling a gust of Cherry Blossoms in one of the VR levels
-
Pulling a ball of water out of the pond
-
Levitating ball of water with ethereal manta rays flying through the sky
-
Controlling gusts of wind across a field
-
Painting Aurora's in Mixed Reality
Inspiration
I enjoy making beautiful visuals and interactions in VR. I wanted for a long time to add more hand-based interactions to create visuals. Air & Water bending from Avatar and using the force from Star Wars were all inspirations for interactions I wanted to create. Mixed reality adds a whole other level of immersion to an interaction like that. I was further inspired from a lot of time I've spent in Japan with all it’s bamboo forests and koi ponds, as well as I have had the chance to see the Northern Lights across Canada. I have always thought how cool it would be to be able to paint the sky and water with bright light and bioluminescence.
What it does
Aurora Zen is meant as a peaceful mindfulness and meditation app. It uses hand tracking for a natural and intuitive way for people to light up ponds with ripples of Biolumiscent light, paint the sky with Aurora’s, and to change the direction of the wind across broad fields.
How we built it
I first built just the Aurora version on mobile, and then VR last year. This year I wanted add a big update with a mixed reality version along with additional inputs like drawing a koi pond, levitating water, and controlling bursts of cherry blossoms.
Challenges we ran into
Performance was a big challenge. I could get this running well on a Windows computer through the headset, but it required some additional work to get it working standalone on the Quest 3. I revisited the performance best practices of not using depth buffers and reworked some shaders to improve the performance while also keeping the visuals fidelity as best I could. I also needed to balance optimizing features like Foveated Rendering so that I could squeeze as much out of the hardware as I could.
Accomplishments that we're proud of
The Mixed Reality Koi Pond turned out really well. I liked how intuitive it was to create the pond and then it felt like it was really there. I’d even naturally try to “step” over the pond, forgetting that it wasn’t actually there. I also liked that it was procedural as I'd go back and create new ponds in new rooms of my house.
What we learned
Hand interactions are an input mechanism that takes a lot of iteration to get what feels natural. That iteration on the input then also will modify the design.
What's next for Aurora Zen - Mixed Reality
I’d like to make some more levels but I’m getting pretty close to the maximum size of a VR experience on Quest. I’d like to polish the experiences a bit more and then move the levels to asset bundles/addressables so that I could host them as a separate download, allowing me to create more levels. I may also experiment with App Space Warp to see if I can pull a bit more performance out of the headset.
Built With
- foveated
- handtracking
- koipond
- unity
