-
-
3D reconstruction from video
-
Viewing of a 3D model
-
Augmenting an image onto the camera
Inspiration
We aim to resolve an issue plaguing humanity since the beginning of time. We hope to answer the question, does this furniture fit in my home?
What it does
Introduces a new service for an overlooked group of furniture owners, making it seamless for them to showcase and sell their products. By leveraging Augmented Reality and 3D reconstuction, we aim to help users better visualize furniture before purchasing.
How we built it
PlaceIt! is powered by React.js, Three.js, and WebXR on the front end, with a Node.js/Express.js back end. Connected with the backend, we have our Python-powered 3D photogrammetry reconstruction pipeline that uses COLMAP + OpenMVS to convert simple videos into photorealistic 3D models.” We use Supabase for authentication, storage, and database services.
Challenges we ran into
1) Generation of a 3D model from a Video. 2) Projecting and moving the Augmented Object using the phone. 3) Automation of Points 1 and 2 through the use of a Python script. 4) Generation of web UI. 5) Management of Database. 6) How to host a webpage non-locally
Accomplishments that we're proud of
1) 3D viewer 2) Augmented Reality 3) Everything else!!
What we learned
1) Generation of a 3D model from a Video. 2) Projecting and moving the Augmented Object using the phone. 3) Automation of Points 1 and 2 through the use of a Python script. 4) Generation of web UI. 5) Management of Database. 6) How to host a webpage non-locally (through the use of ngrok)
What's next for PlaceIt
1) To improve the 3D generation of the models uploaded by users. 2) To improve the augmented object placement. 3) To allow for multiple augmented object placements. 4) To expand the targeted audience to that of furniture vendors by creating business accounts.
Log in or sign up for Devpost to join the conversation.