Virtual Clothes Try-on Extension

Inspiration

I was looking for such an extension and couldn't find it. So, decided to make it myself.

What it does

It lets you upload your photo and lets you select/upload a dress/outfit and it will show you how that piece of outfit will look on you.

How we built it

Used Javascript, HTML, and CSS on the front end to make the Chrome extension. Used node.js and express.js on the backend. Used the IDM-VTON model using fal.ai's API to generate an image of the try-on.

Challenges we ran into

The challenge we ran into was finding the right model for this exact purpose and experimenting with other open-source solutions. We found one eventually but the challenge we are facing right now is the time it takes to generate a try-on image. The best model we could find takes at least 30 seconds to generate an image which is not great but will keep on working on it.

Accomplishments that we're proud of

We are quite proud of what we were able to achieve in such a short amount of time with such a small. At last, we have a working MVP which was working as expected.