Fashion Buy

An AI-powered 3D Fashion E-Commerce Studio: design outfits from text, try them on virtually, project millimeter-accurate AR cutting patterns onto fabric, and checkout seamlessly with PayPal.

Comment

Inspiration

Inspiration

Online fashion e-commerce suffers from two massive challenges: high return rates because shoppers cannot visualize how garments fit their unique bodies, and slow, wasteful tailoring workflows for independent makers and designers. We built FashionBuy: AI Makers 3D Studio to bridge digital e-commerce with physical tailoring in a single interactive 3D space.

What it does

FashionBuy transforms the entire fashion lifecycle from imagination to checkout and physical production:

  • Interactive 3D Showroom & Private AI Stylist: Users explore a 3D studio, browse curated collections, or chat with our AI-powered Private Stylist to discover real-time outfits tailored to their style profile and season palette.
  • AI Design Sketcher: Users describe any dream outfit in plain text, and our generative AI engine creates studio-grade fashion concept designs on the spot.
  • Virtual Fitting Room & AI Fit Critique: Shoppers upload a photo to preview garments in our Virtual Fitting Room, while Gemini Vision analyzes their body profile and photo to deliver a real-time fit score and personalized styling advice.
  • Voice-Controlled AR Tailoring & Parametric Patterns: Using hands-free Web Speech Voice Commands (e.g., "Focus on cutting board"), makers select from 30 parametric patterns powered by FreeSewing. Using 5 body measurements, the engine projects a 100% transparent dotted cutting stencil onto the cutting mat and Smart Glasses AR with real-world centimeter zoom lock.
  • Seamless E-Commerce Checkout: Shoppers and makers can purchase garments or custom patterns in seconds using PayPal and PayPal Pay Later.

How we built it

  • Frontend & 3D Engine: Three.js, WebGL, CSS3DRenderer, HTML5 Canvas, and Web Speech API for hands-free voice navigation.
  • Backend: Node.js (server.cjs) hosted on Render with REST API endpoints for AI orchestration and static 3D asset delivery.
  • AI & E-Commerce Integrations:
    • PayPal & PayPal Pay Later for instant e-commerce checkout.
    • Google Gemini API for styling recommendations and multimodal fit analysis.
    • Generative AI Vision & Image Models for live outfit sketching and virtual try-on previews.
    • FreeSewing for parametric sewing pattern drafting.

Challenges we ran into

Synchronizing real-world centimeter measurements between the 3D cutting mat and the live AR camera feed required building a dynamic calibration zoom-lock algorithm so tailors can cut fabric accurately without distortion. Integrating multiple AI services into a unified, low-latency 3D interface also required careful backend fallback handling.

Accomplishments that we're proud of

  • Combining 3D Web E-Commerce, Generative AI, AR Tailoring, and PayPal Checkout into one cohesive studio.
  • Delivering transparent dotted cutting stencils that keep real fabric visible underneath during AR projection.

What's next for FashionBuy

  • Adding live MediaPipe webcam body-measurement scanning directly in the browser.
  • Expanding the live fashion catalog and multi-currency PayPal payouts for independent pattern makers.

What it does

How we built it

Challenges we ran into

Accomplishments that we're proud of

What we learned

What's next for Fashion Buy

Share this project:

Updates

Submission history