[C16] Xpression

We bring the freedom of virtual self-expression into the real world outfits and adapt them context-aware. It’s a new way to bridge virtual identity and physical environment.

Comment

Inspiration

In virtual spaces, people enjoy the freedom of endless self-expression through avatars, skins, and digital fashion. We wanted to bring that same creativity into the real world transforming everyday clothes into dynamic canvases for identity, emotion, and context. Our inspiration also comes from sustainability: instead of endlessly consuming fast fashion, why not adapt what we already own?

What it does

Xpression is a mixed-reality experience that lets you dynamically change your outfit in real time. It allows people to:

  • Express themselves visually without words
  • Switch styles instantly depending on mood or social context
  • Imagine new business models where people buy virtual fashion instead of physical clothing

How we built it

  • Integrated BodyPix (segmentation & pose estimation) with Unity Sentis for real-time body tracking
  • Used Meta PCA and OpenAI for environment type detection, enabling adaptive outfit presets
  • Downsampled and upsampled keypoints from BodyPix to estimate live body position and overlay mixed-reality wearables

Challenges we ran into

  • Running a computer vision model inside Unity for the very first time
  • Achieving real-time performance while keeping body tracking accurate
  • Ensuring smooth alignment between live motion and virtual outfits

Accomplishments that we're proud of

  • Successfully integrated a CV model into Unity and made it run in real time
  • Built a working prototype that demonstrates the concept of dynamic virtual fashion
  • Explored sustainability-focused innovation in fashion tech

What we learned

  • How to apply pose estimation and segmentation models in Unity
  • The importance of context-aware design for wearable experiences
  • The huge potential of merging fashion, technology, and sustainability

What's next for Xpression

  • Expanding the digital clothing library with more styles and presets
  • Creating a marketplace for designers to sell virtual outfits
  • Testing with real users and improving accuracy for everyday use

Built With

Share this project:

Updates