BuyByFit

Inspiration

Buying furniture online is challenging. It's hard to know whether a piece will match your room's style, fit your space, or create the atmosphere you're imagining.

Most furniture websites focus on individual products rather than the room as a whole. We created BuyByFit to change that — helping users visualize their ideal space, discover matching furniture, and turn inspiration into reality.

What it does

BuyByFit is an AI-powered room restyling and furniture discovery platform that helps users redesign and shop for their ideal space.

Our three core features are:

AI Room Restyling: Upload a room photo and generate a redesigned version, with an interactive before-and-after slider to explore the transformation.
Shoppable Furniture: Discover real furniture featured in the redesigned room, including product details, dimensions, and purchase links.
Personalized Styling Advice: Receive tailored suggestions on colors, materials, lighting, and aesthetics from our fine-tuned interior design expert.

Users can also discover furniture through natural-language and voice search, with recommendations based on their preferences and budget.

How we built it

We built BuyByFit as a full-stack application combining generative AI, fine-tuned models, and semantic recommendations.

Frontend: Next.js, React, TypeScript, and Vercel, featuring interactive room comparisons and shoppable product cards.
Backend: Python, FastAPI, PostgreSQL, and pgvector for API services and semantic furniture search.
Generative AI: Gemini generates redesigned room visualizations guided by design-specific feedback.
Fine-tuned Expert: Inkling 2 Small with a LoRA adapter, trained using Tinker on approximately 3,200 interior photos labeled with Gemini 3 Flash and checked against 100 human labels.

Our fine-tuned model plays two roles: it analyzes the original room (colors, materials, lighting, and cohesion) to guide Gemini's redesign, then generates up to three personalized styling suggestions after the final image is selected.

Challenges we ran into

Making AI designs actionable: Connecting generated room transformations with real, purchasable furniture rather than just producing attractive images.
Coordinating multiple AI models: Integrating our fine-tuned design expert with Gemini while keeping their responsibilities clearly separated.
Balancing functionality and simplicity: Combining visualization, recommendations, and styling guidance into an intuitive shopping experience.

Accomplishments that we're proud of

Fine-tuned a specialized interior design model using Tinker and LoRA on approximately 3,200 labeled photos.
Built an expert-guided AI redesign workflow combining specialized design analysis with Gemini image generation.
Developed an interactive before-and-after room transformation experience with shoppable furniture and personalized styling advice.
Integrated semantic furniture recommendations into a publicly accessible, full-stack MVP.

We're especially proud that BuyByFit goes beyond generating room images — it connects design inspiration with real-world shopping.

What we learned

We learned that successful AI-powered design tools need more than visually appealing outputs. They must help users make practical decisions.

Fine-tuning a specialized model showed us how domain expertise can complement general-purpose generative AI. We also gained hands-on experience with LoRA fine-tuning, multi-model workflows, semantic search, and full-stack development, while learning how to balance technical capabilities with user experience.

What's next for BuyByFit

Retail Partnerships: Partner with furniture retailers like IKEA, Home Depot, and Amazon to promote their products through personalized, shoppable room designs.
Interactive Furniture Customization: Allow users to drag, move, replace, and customize individual furniture pieces within their redesigned rooms.
3D/AR Room Visualization: Bring room designs into interactive 3D and augmented reality experiences, helping users better understand furniture placement, dimensions, and fit before purchasing.

Our vision is to bridge the gap between interior design inspiration and furniture shopping — making it easier for anyone to visualize, personalize, and bring their dream space to life.

BuyByFit — Restyle your room. Shop the look.