Alt text

Inspiration

The inspiration behind Decor stemmed from the desire to leverage the power of technology to streamline the interior design process. We wanted to create a tool that would empower users to visualize and plan their living spaces with ease, ultimately enhancing their ability to make informed decisions about furniture and décor.

Alt text

What it does

Decor allows users to augment their physical surroundings using virtual furniture and décor elements. By utilizing augmented reality technology, users can virtually place items within their space, allowing them to see how different pieces will look and fit before making any purchases. Additionally, Decor features a voice-powered AI assistant that can provide product recommendations and answer questions related to interior design.

How we built it

Alt text

We built Decor using a combination of augmented reality technology, voice recognition software, and artificial intelligence. The core functionality of the app was developed using Unreal Engine and the Meta Quest SDK, allowing us to create a seamless AR experience for users. We integrated Wit.AI for voice recognition, enabling natural language interactions with the virtual assistant. Additionally, we utilized various APIs and databases to provide users with accurate product information and recommendations.

Functionalities used :

Alt text

Depth

We used hard depth pass to allow for a more immersive experience allowing pre-existing obstacles to occlude the virtual setup.

Passthrough

It's the core functionality that allows for the application to be a Mixed Reality application, allowing us to super impose graphics on the camera passthrough

Space

Spatial data allows us to access the user's room scans allowing us to position and manipulate virtual elements in a sensible manner around the room.

Spatial Anchors

Spatial Anchors allow us to implant static elements in the scene and have them locked in place as the user moves around with the addition of save and load functionality

VOICE SDK

We used Voice SDK in conjunction with Wit.AI for NLP to develop a prototype virtual assistant that can provide useful suggestions to the user entirely via spoken word through the use of Text-To-Speech and Speech Recognition functionalities provided by Voice SDK

Virtual Assistant

Through the use of speech recognition, TTS and NLP, we've integrated a virtual assistant in Decor. The assistant is trained to respond to queries related to interior decor and technical suggestions such as color combinations, Appropriate AC capacities, etc. The assistant makes it easier for the user to make choices that are both more aesthetically pleasing as well as more technically appropriate for their individual circumstances.

Alt text

Challenges we ran into

One of the main challenges we faced was ensuring the accuracy and stability of the augmented reality experience. Aligning virtual objects with real-world surfaces and maintaining tracking stability required extensive testing and optimization. Additionally, integrating voice recognition technology and training the virtual assistant to accurately respond to user queries presented its own set of challenges.

Accomplishments that we're proud of

We're proud to have developed a user-friendly and intuitive tool that combines cutting-edge technology with practical utility. Creating an AR experience that seamlessly integrates with users' physical environments and provides valuable insights into interior design was a significant accomplishment for our team. Additionally, we're proud of the functionality and responsiveness of the voice-powered AI assistant, which enhances the overall user experience.

What we learned

Throughout the development process, we gained valuable insights into augmented reality development, voice recognition technology, and artificial intelligence. We learned how to optimize AR performance for different environments and devices, as well as how to effectively train and deploy a virtual assistant using natural language processing techniques. Additionally, we gained a deeper understanding of the challenges and opportunities inherent in the intersection of technology and interior design.

What's next for Decor

We plan on expanding the used SDKs provided by meta as well as looking into more e-commerce related integrations that could make Decor a viable form of Virtual Shopping in addition to interior decor. we plan to continue refining and expanding Decor to provide even more features and functionality to users. This includes adding support for additional furniture and décor items, enhancing the capabilities of the virtual assistant, and integrating with e-commerce platforms to enable seamless purchasing directly within the app. We also aim to explore opportunities for collaboration with interior designers and retailers to further enhance the user experience and provide valuable resources to our users. Overall, we're excited about the potential for Decor to continue revolutionizing the way people design and furnish their living spaces.