Inspiration
Moving from dorms into apartments meant building a lot of flat-pack furniture, and the manuals were confusing. We kept putting parts on backwards and starting over. We wanted a way to see each step before doing it.
What it does
Furnisure turns a furniture manual into a 3D walkthrough. Scan the manual, and each step plays as a 3D animation, with an allen key showing every screw going in. In our iPhone app, Scan my step uses LiDAR to check whether you built the step correctly.
How we built it
- Gemini API reads the manual's parts and steps
- Python + FastAPI server
- Three.js and Manifold-3D to build and animate the 3D models
- Swift, ARKit and LiDAR for the iPhone app and step checking
Challenges
- Integrating the AR and LiDAR features with the web app
- Building accurate 3D models from manuals that rarely give exact sizes
- Animating parts so they don't pass through each other and screws go in the right way
What we learned
How to use AI APIs, AR and LiDAR, and a lot about 3D graphics and animation.
What's next for Furnisure
Make it more interactive and cover a much wider range of furniture products.
