Roomify: Imagine It. Shape It. Experience It.

Turn the world around you into a canvas for your imagination. Scan real spaces, bring objects to life in 3D, and redesign your reality with the power of AI.

Inspiration

Have you ever wondered what your room would look like with a different layout, new furniture, or an entirely different aesthetic?

Maybe you've found the perfect couch online, but you're not sure if it would match your curtains? Or even fit through your doorway?

Or perhaps you're moving into a new apartment and wish you could experiment with furniture arrangements before moving anything in.

We wanted to make imagining these possibilities as easy as bringing them to life.

Traditional interior design software often requires technical knowledge, manual 3D modeling, and hours of work. Meanwhile, AI image-generation tools can create beautiful room designs, but those images aren't necessarily interactive, spatially accurate, or easily editable.

We wanted to bridge that gap.

What if designing your space were as simple as taking a picture or a video and describing what you want?

That question inspired Roomify, an AI-powered spatial design platform that aims to make 3D environments accessible to everyone, regardless of their design experience.

What It Does

Roomify brings together computer vision, 3D reconstruction, conversational AI, and immersive technology to transform how people interact with physical spaces.

Our vision centers on several connected experiences:

Scan Your Space: Capture moving video of a room and reconstruct its approximate layout as an interactive 3D environment.
Picture to 3D Object: Photograph real-world furniture or other objects and transform them into reusable 3D assets.
Seamless Cross-Device Interaction: Capture an object on your phone and swipe it into your desktop design workspace.
AI-Powered Design Assistant: Describe changes naturally, such as "Spawn a wooden cupboard beside my desk" or "Make the walls sage green."
Interactive Scene Editing: Move, rotate, resize, recolor, add, and remove objects within a virtual environment.
AR/VR Visualization: Explore how proposed designs would look in an existing physical room or experience them through an immersive walkthrough.

Rather than generating a static picture of a redesigned room, Roomify focuses on creating a persistent, editable spatial environment.

The goal is to give users a creative workspace where they can experiment with ideas before spending money, moving furniture, or making physical changes.

How We Built It

One of the most exciting parts of building Roomify was working with newly released computer vision technologies. Meta's SAM 3D Objects, released on November 19, 2025, made it possible to reconstruct approximate 3D objects from individual images. These advancements helped us bring real-world spaces and objects into interactive digital environments.

Roomify is designed around a modular pipeline connecting real-world image capture with semantic 3D scene editing.

1. Computer Vision and 3D Reconstruction

We explored recently released foundation models, including Depth Anything 3, Meta's SAM 3D Objects, and technology frameworks like Apple RoomPlan to estimate scene geometry and reconstruct objects from ordinary images or room plans from moving video.

2. Interactive 3D Environment

The design workspace uses a scene-graph approach, where individual objects maintain properties such as their position, orientation, scale, and materials.

This makes it possible to manipulate elements independently instead of regenerating an entire image whenever the user requests a change.

3. Conversational AI

The ElevenLabs assistant translates natural-language requests into structured scene operations.

For example, "Move the chair next to the table and make it blue" can be represented as separate object-selection, transformation, and material-editing commands.

4. Cross-Device Experience

Our architecture connects mobile capture with a desktop-based design workspace, allowing reconstructed objects to move between devices without requiring users to manually export and import 3D files.

5. Hardware and Immersive Integration

We have scanned the rooms using our phones and used a VR headset to walk through the room.

Challenges We Faced

One of the biggest challenges with Roomify was bringing several different technologies together into a single, seamless experience.

Some of the main challenges involved:

Connecting different technologies: Integrating room scanning, 3D assets, the interactive editor, ElevenLabs voice assistance, and VR into a unified workflow.
Working with different 3D formats: Making sure scanned rooms and reconstructed objects could be imported, displayed, and manipulated within the same environment.
Translating voice commands into actions: Connecting conversational instructions to specific operations within the 3D scene, such as spawning furniture, changing colors, or moving objects, changing their size and scale.
Cross-device integration: Designing a workflow that allows users to capture objects on their phones and interact with them in a desktop environment.
VR integration: Making the reconstructed room accessible through a VR headset so users could experience their designs immersively.

What We Learned

Working on Roomify highlighted an important distinction: generating a convincing image of a room is very different from building a spatial environment that users can meaningfully interact with.

We explored how modern computer vision models estimate geometry, how reconstructed objects can be represented in interactive 3D scenes, and why maintaining consistent spatial relationships is essential.

We also learned the value of separating AI-powered interpretation from deterministic scene operations.

Rather than allowing an AI model to generate an entirely new image for every instruction, structured commands make scene modifications more predictable, editable, and reversible.

Most importantly, the project reinforced how powerful emerging AI technologies become when they are integrated into a complete interactive experience rather than used in isolation.

What's Next for Roomify?

Our long-term vision extends beyond a room-design application.

We want to develop Roomify into a general-purpose platform for interacting with digital representations of physical spaces.

Future directions include:

Collaborative design sessions.
Integration with real measurements and product specifications.
Covering outdoors/lawns/gardens and other properties

Ultimately, we envision a future where anyone can capture their surroundings, manipulate them digitally, and explore possibilities through natural interaction.

Roomify is our step toward making the physical world as easy to edit as a digital canvas.