foot.print

Inspiration

Dr Cliff Tan, an architect and feng shui expert who shares tips to organize living spaces on social media.

Also, our team will be starting second year of university in fall and will be getting our own places for the first time, adding the responsibility of designing our rooms. So, we wanted to create something to help us, and other students like us, to find the perfect bedroom design.

What is Feng Shui?

It is an ancient Chinese practice that focuses on arranging your surroundings to create harmony and balance with the natural world. It’s often used in interior design to improve the flow of energy, called “qi”, in a space.

What it does

Take a video of your room using your camera. Upload it to our website and it will use AI to generate you the best feng shui layout for your room, outputting a 3d model of your redesigned room.

How we built it

TwelveLabs object detection and time stamp acquisition ->
cv2 extract image from frame using time stamp ->
yolov8 and midas depth prediction ->
Gemini object size prediction ->
Gemini generate blender meshes according to object and room size ->
Gemini run validation loop to make sure no errors in generation-> Blender models the room in 3D

Challenges we ran into

very hard to merge yolov8 depth prediction and gemini object size prediction
also gemini kind of sucks at generating coordinates for the furniture

Accomplishments that we're proud of

Being able to accurately estimate object dimensions based on depth and relative distances Being able to output a valid room layout (within the bounds and no overlapping furniture) Being able to dynamically generate 3d models for the room