Inspiration

One of us wanted to do an idea that involves making shopping onlne more practical. The other one of us wanted to do something with 3-d scanning to translate real world objects in to virtual ones. We ended up combining the ideas and we ended up with FittingRoom!

What it does

The program will scan your movements as you rotate in a circle. Once that is done, you will be able to select a shirt and a pair of pants from real companies, and see how they will look on you. You are able to rotate yourself to see all angles and get a full 360 view of yourself in a virtual outfit to help you decide if it will become your new real outfit.

How we built it

We built it by getting a full 360 view of the person where the limbs are tracked, then when you select a piece of clothing, ChatGPT will take all of the models photos of the clothing and develop a good idea of how it looks in 3d, and it will put it on your person in 12 differnet angles based on the original video. After, Gemini will use those angles to create a seemless recreation of your original movements, but now with your new outfit on, giving you a photo realistic look of yourself in your potential set of clothes.

Challenges we ran into

When working with ai to generate things like this, it tends to hallucinate occasionally deviating away from reality. The persons face might morph, or the final video would not fully line up with the original. But after some problem solving we got our program to be consistently accurate to a point we are very happy with.

Accomplishments that we're proud of

We did not have as much time as everyone else due to an exam a group member had on Saturday morning, meaning we missed out on the first night of this event. But despite the constraints, we ended up delivering a program we are genuinley proud of that we believe has real world applications that any human can benefit from. That is by far what we are most proud of.

What we learned

We learned that even if the idea seems a little ambitious, it is still worth a shot. When we were brain storming we came up with this idea that we liked but we weren't sure we would be able to get it done with the limited time. But we tried it out to see how much progress would be made in the first few hours and we were very happy to see that this is something we could finish by the due date. If we did not take the chance to do this project, I think we would have settled on a project that would not have been as fuffiling for us.

What's next for FittingRoom

Currently our program only supports shirts and shoes. We would extend our catalogue to shoes and jewlrey. Furthermore, due to hardware constraints, it takes a while to generate the angles and videos, so we would try to work to optimize it better and if this program were to be taken forward after this event, we would look at more powerful servers to run our program off of in order for it to function quicker.

Share this project:

Updates

Submission history