Wall Changer MR: Interior Simulator

Inspiration

Everyone has looked at a wall and wondered, "What would this look like in a different color?" But renovation is expensive and irreversible. We wanted to bridge the gap between imagination and reality. Inspired by the Meta Presence Platform, we built a tool that lets anyone instantly "dress up" their reality without using a single drop of paint.

What it does

Wall Changer MR scans your physical environment and re-textures real-world walls and ceilings in real-time.

Spatial Awareness: Uses spatial data to identify and differentiate between walls, ceilings, and furniture.
GenAI Customization: Offers seamless, high-resolution wallpapers generated by Midjourney (with prompts optimized by Gemini).
Magic Moment: simply point your controller at a boring white wall and pull the trigger. The wall instantly transforms into stylish brick or natural patterns, maintaining the room's physical sense of space.

How we built it

We built this using Unity and the Meta Presence Platform.

Scene Understanding: We utilized Unity AR Foundation to detect wall and ceiling planes, precisely aligning digital textures with the physical world.
GenAI Pipeline: To ensure textures looked natural at room-scale, we used Gemini to craft prompts and Midjourney to generate 2048x2048 seamless textures.

Challenges we ran into

Stability vs. Functionality: We faced a conflict where updating packages stabilized the Passthrough (floor visualization) but made furniture recognition unstable. We rigorously tested multiple SDK versions to find the perfect balance.
Occlusion & Depth: Rendering wallpaper strictly behind physical furniture proved to be a major technical hurdle. Currently, textures occasionally overlap objects in the foreground, which we have identified as a key issue for the next iteration.

Accomplishments that we're proud of

Seamless Integration: We achieved a level of visual fidelity where digital wallpapers look as if they are actually painted on the physical wall.
AI-Driven Workflow: We established a streamlined pipeline where AI-generated assets (Midjourney) can be directly implemented as high-quality MR textures without manual adjustment.

What's next for Wall Changer MR

Solving Occlusion via Depth API: Our top priority is implementing the Depth API. This will resolve the occlusion issues, ensuring wallpapers render correctly behind real-world furniture.
Community Patterns: We plan to add a feature where users can generate textures via API and share their unique room designs with the community.