Inspiration
The usage of interior mapping systems to find specific rooms in buildings you're not familiar in
What it does
Scans a room, and uploads a 3d and 2d model of said room with ability to move around the objects in the room.
How we built it
USed 3d transformer models for segmentation and with the help of OpenCV segmented the objects within the room and the room itself and then used Unity to help edit or move objects within the room around.
Challenges we ran into
Finding a good transformer model, being able to segment objects independently, uploading model into UNity
Accomplishments that we're proud of
Being able to extract a floor plan, segment iit in 2d and 3d form and be able to edit the objects in the room with a gaming software
What we learned
How to use segmentation models, how to use unity, how 3d gaussian splat works, and the work strain put on gpus for such models
What's next for 3D Segmentation and Reconstruction Model
Integrating for smoother real-time operations and being able to access a larger database.
Log in or sign up for Devpost to join the conversation.