NatureInk AI

Inspiration

The idea for Nature Ink emerged from a fascination with the textures and materials that surround us every day. From the intricate patterns of tree bark to the smooth surfaces of everyday objects, each material tells a story. I wanted to harness this beauty and translate it into an intuitive mixed reality experience. The goal was to allow people to connect with their environment in a new way, capturing and reimagining textures to design virtual objects and spaces effortlessly.

This concept also drew inspiration from iconic scenes in pop culture, like the Sentinels from X-Men absorbing mutant powers and Kevin Levin from Ben 10 absorbing materials into his body. These moments of transformation and empowerment inspired me to make the world around us a living palette of creativity, where users could absorb and repurpose textures with ease.

Functionality

Nature Ink is a mixed reality design tool that lets users absorb real-world textures and apply them to virtual creations. By pointing and pinching, users can capture the texture of any surface, which is animated onto their hands in a smooth, magical transition. These captured textures are stored in a dynamic hand menu, where they are upscaled using generative AI for maximum detail.

The material application process is designed to feel intuitive and responsive. One hand carries the absorbed materials, while the other is used for functionalities like rotating platforms, adjusting ambient lighting, or switching between materials. This dual-hand interaction, combined with fluid animations, creates an immersive and fulfilling experience. Users can customize miniature trees, low-poly worlds, or everyday obejcts, turning everyday materials into stunning digital masterpieces.

Challenges I ran into

The most significant challenge was ensuring that the texture capture and application system felt fluid and responsive. Fine-tuning the hand-tracking system to accurately recognize gestures and seamlessly animate textures onto the hand required extensive prototyping. Additionally, integrating generative AI for real-time texture upscaling without compromising performance was a technical hurdle. These challenges pushed me to innovate, balancing complexity with usability to create an experience that feels effortless for the user.

What I learned

Building Nature Ink was a challenging yet rewarding process that deepened my understanding of intuitive design in mixed reality. Through developing the texture capture system, I learned how to blend passthrough feed with generative AI, ensuring both precision and performance. Experimenting with dynamic animations taught me how to make interactions feel magical yet natural. Most importantly, I focused on making the experience more responsive, with fluid animations and natural interactions for absorbing and transferring textures between hands. This enhanced the immersion and creative potential of the tool.

What's next for NatureInk AI

Nature Ink’s potential goes far beyond capturing and applying textures. The next step is to expand its functionality, enabling users to craft entire worlds inspired by the materials they collect. Imagine designing immersive forests, cities, or even interactive story-driven environments where every element is tied to real-world textures. Future iterations could also include collaborative features, allowing users to share their creations or combine textures for joint projects. By integrating advanced AI tools, Nature Ink could even generate narratives and unique experiences tied to the designs.

Nature Ink redefines how we engage with our surroundings, turning the ordinary into extraordinary. It’s not just a tool—it’s a platform for unleashing creativity, connecting people with their world, and inspiring entirely new ways to design.

Credits Nike Pegasus shoe model: quaz30 (sketchfab) Midi top: Pixel swan (sketchfab)