Vibey Ghost

• GIF

  Demo 1

• 

  Cloth Simulation Blender

• 

  Vertex Painting Blender

• 

  Programming and Assembly Lens Studio

• GIF

  Demo 2

• 

  Demo 3

Inspiration

Inspiration for this spotlight lens comes from the Ghost Cloth Trend 👻 For those who are not aware in this trend, people dress themselves up as a ghost with white bedsheet and cool shades to pose for some of the most aesthetic pictures and videos. Reference Here

So I thought why not do it in AR?👻

What it does

Vibey Ghost lens allows users to dress up like the ghost like in the cloth ghost trend and vibe to the music and create some amazing and engaging spotlights. It uses real-time cloth simulation capability of the SnapAR to provide realism to the body movements and enable users to be creative with their spotlights.

How I built it

The process include two major flows: 1. Blender Cloth Simulation & Export -> Creating a blender simulation environment for cloth physics and collisions using planes and sphere -> Run the simulation to output the required ghost shaped cloth model -> Isolate the model and perform vertex painting to select the parts for binding with body parts inside
lens studio -> Optimize the polycount and export the model in appropriate format ( FBX in this case )

2. Lens Studio Cloth Simulation & Post Processing -> Open the new project and import the model exported from blender with vertex color option selected -> Setup cloth simulation scripts and insert imported cloth mesh inside -> Tweaked the parameters according to liking and to give it as realistic movements as possible -> Created colliders and occluders to add to the realism -> Added cool shades to tracked to head binding -> Built style variants for users to choose from when tapping on the screen through a carousel UI -> Programmed a variant controller script to switch between the variants -> Style variants include various post processing effects and color corrections along with vignette frames.

Challenges I ran into

The most challenging part was the 3D modelling part where the cloth simulation inside blender had to be setup correctly. Coming from a technical background this was very challenging for me. Along with this tweaking parameters inside lens studio for proper simulation took a long time to get to this near perfect results.

Accomplishments that I'm proud of

I'm really proud of the whole experience as it has turned out to be. One thing in particular is the blender modelling and simulation part. I'm by passion and profession a programmer first and have recently started learning about 3D modelling, so this was a great initial achievement for me in this skill.

What I learned

I learned cloth simulation inside blender. It was also my first time vertex painting. So got to learn about how coloring vertices helps with various bindings in simulation.

What's next for Vibey Ghost

Tbh haven't thought of it much as I intend this to be a funny scary experience potential of becoming a spotlight trend spreading spooky vibes over the halloween season. For next bits, I'll try to include more style variants, and even glasses options. I have also thought of giving cartoony expressions to the ghost to match with facial expressions of the users.

Built With

• blender
• javascript
• lensstudio
• snapar
• visual-studio-code