XR Fashion Marketplace

Enabling fashion brands get started with virtual fashion and create new revenue streams via NFTs

Comment

Inspiration

Online shopping for fashion items faces a visualization problem, where current platforms showcase products using pictures/videos and the customer is required to imagine themselves wearing the apparels. This problem is global yet blockchain + immersive tech powered by AI is on the rise and beginning to be computationally inexpensive. Also the pandemic introduced social distancing and the need for virtual shopping rised.

What it does

Our fashion marketplace allows fashion brands to upload their existing cataloges with photos and by using algorithms, we automagically create 3D assets of the clothings using algorithms. These assets are crucial to offer immersive experiences. These assets are also minted to create NFTs.

Shoppers can browse our marketplace, pick an apparel they want to view and they can visualize the item using our XR integrations (in mobile AR or VR headsets). They can also upload a picture of themselves and try-on the clothing, allowing them to see how they'd look. We also provide product configurators on special cases allowing the customer to personalise clothing.

Shopper can add items to the cart to order physical products or simply buy the digital version of the clothing via NFTs.

How we built it

The platform is built with node js for app dev (uses NX for mono-repo design pattern) and python for ML dev. The backend is graphQL-based built with NestJS and Apollo.

The frontend is built with Angular framework, Spectre CSS for styling and the webXR spec via threeJS for creating the immersive experiences.

For ML, we use pytorch for training and exporting all models using ONNX format, some models are from intel's openvino zoo. For running the ML pipeline, we use Redis Streams + Redis AI.

For NFTs and CELO integration, we used tatum due to it's developer friendly nature

Challenges we ran into

  1. Implementing gas fees efficiently and figuring out UX for purchasing NFTs especially for people who don't know anything about crypto.
  2. Running ML inference on edge devices is really difficult, but needed to avoid privacy issues.

Accomplishments that we're proud of

Being part of Oculus Launchpad Program 2021, learning VR development and seeing the role of NFTs in the metaverse.

What we learned

NFTs provide an extra revenue streams for brands. ML architectures are critical in creating AI powered apps. XR provides immersive experiences that are fun and kinda exciting for online shoppers.

What's next for XR Fashion Marketplace

  1. Build droid/ios apps for image editing using the NFT assets a user has in their wallets. It will have fashion stylist games and challenges.
  2. Add hair styling for visualizing the shopper's look
  3. Deploy our VR experience in Oculus platform, we're building a digital mall hosting shops for fashion brands and we'll have gaming sections in the mall.
Share this project:

Updates