Rainforest Mixed Reality

Toucan
Welcome message
Taking a photo
Interface info on toucan and sound
Collecting a sticker
Interacting with Toucan

Inspiration

We drew inspiration from a variety of sources to shape our approach. This included educational CD-ROM games from the 90s. These early educational tools were innovative for their time, making learning both fun and immersive through visually-rich environments and engaging, hands-on experiences. The way those CD-ROMs combined education with adventure sparked our vision for creating a similar blend of interaction and exploration in today’s digital landscape.

We also explored modern apps that incorporate augmented reality (AR) and interactive features to create immersive learning experiences. We wanted to draw from both modern and old school design.

What it does

This project brings the vibrant, dynamic rainforest environment right into the user's living room, allowing them to interact with it as if they are physically there. The app is aimed at younger audiences who can learn about the diverse creatures that inhabit the rainforest, their behaviors, and ecological roles.

A key feature is the ability to interact with the environment in a hands-on way, such as picking up a magnifying glass from a virtual backpack and inspecting creatures in great detail. By zooming in or scanning, users can discover information about the species, including their habitats, diets, and unique traits. It’s an educational experience that fosters curiosity and exploration.

How we built it

The foundation of this project was created using ShapesXR, a powerful platform for building interactive 3D environments in mixed reality. We designed the various rainforest scenes with the goal of achieving a highly immersive experience, ensuring that users feel as though they are genuinely walking through a jungle. For many of the models, we turned to Sketchfab, a rich repository of 3D assets, to provide a wide range of animals and plants. These assets were then customized in Blender to fit the app's visual style and needs. For instance, the textures of some models were altered, or their shapes were refined to create a more lifelike and consistent experience.

Additionally, we used Figma for crafting the app's user interface (UI). The clear and intuitive layout was designed with younger users in mind, ensuring that even those with limited experience using digital devices could easily navigate the app. We integrated Figma directly into ShapesXR through a plugin, allowing for seamless communication between the design tools and the 3D environment. This integration also made it easier to fine-tune the interface as we progressed.

Challenges we ran into

Accomplishments that we're proud of

We’re incredibly proud of the creative concept that emerged from our work. The rainforest is a captivating, dynamic environment, and the design elements bring it to life in an engaging way. By focusing on interactive elements, like the magnifying glass and detailed species exploration, we managed to provide both an educational and fun experience.

The scenes themselves are vibrant and dynamic, drawing users in with their sense of realism and depth, making the rainforest feel alive.

What we learned

Through the development of this project, we learned a great deal about using ShapesXR for 3D environments and interactions. The platform's unique features allowed us to create highly interactive scenes that feel natural and immersive. We also deepened our understanding of designing for mixed reality, learning how to ensure that the user interface and experience are optimized for an immersive world.

Working with Blender and Sketchfab provided valuable experience in 3D modeling and asset customization, which gave us greater control over the look and feel of the app. This also led to a deeper understanding of optimization, ensuring that models perform well in real-time environments without compromising quality.

The process of integrating Figma into the 3D world was another valuable lesson. It gave us a deeper appreciation for UI design, particularly when creating interfaces that need to be both functional and visually appealing, while also considering the different needs of young users.

What's next for Rainforest Mixed Reality

Looking ahead, we plan to expand the app’s features to further enhance the educational experience. Adding mini-games, such as quizzes and challenges related to the animals and their behaviors, will give users an opportunity to test their knowledge in a fun, interactive way.

Additionally, we’re planning to introduce more animals, expanding the variety of species that users can discover. By increasing the diversity of creatures, we aim to create a richer, more engaging world for users to explore.

Weather effects will also be added to the environment, simulating rain, thunderstorms, and other weather conditions that are characteristic of rainforests. This will further immerse users in the ecosystem, allowing them to observe how animals react to these changes and learn about the rainforest’s dynamic nature.