Rainbow Teddy Bear

• 

  Teddy bear after applying the rainbow lens

• 

  Teddy bear used as demo

• 

  Experimenting with the rainbow effect

Inspiration

I was inspired on my first lens project: Melt Cup

What it does

What this lens does is detect teddy bears, and then apply a rainbow effect by mean of segmentation and machine learning

How we built it

1) I followed all the instructions in the Custom Segmentation template guide; 2) then I opened the segmentation_training.ipynb notebook; 3) I opened google colaboratory; 4) I made some small changes to segment teddy bears and you can see in this link teddy_bear_training.ipynb; 5) Following the steps in step 1, I downloaded the "teddy_bear_training.onnx" model, then I opened the Lens Studio program and loaded this model, which you can download at this link teddy_bear_training; 6) Finally I have added the "Rainbow color correction", so the rainbow effect to my teddy bear was created when I applied a mask the image or video, 7) Lens Studio project you can download at this link Rainbow Teddy Bear - Github; and 8) My Lens Project is public, unlocked, and you can get this link Rainbow Teddy Bear

Challenges we ran into

There were complicated challenges, but satisfying to do! 1) Google Colaboratory offers little time to experiment for free (4-5 hours per day); 2) In Lens Studio documentation I didn't find enough technical support to solve technical problems, I hope they publish some tutorial or more documentation on machine learning (how to solve technical problems, how to make a machine learning template, or how to use other machine learning tools like kaggle); and 3) there are no machine learning webinars with Lens Studio and taught by technical staff.

Accomplishments that we're proud of

I finally make my second Lenses with Lens Studio and Machine Learning , now I just have to experiment with more templates. Achieve a good teddy bear segmentation thanks to artificial intelligence training, plus the excellent tools of Lens Studio.

What we learned

I also learned how to experiment with various types of effects and color corrections that can be applied to the lens I'm developing. Hopefully the technical staff of Lens Studio will develop more tools or improve the version.

What's next for Rainbow Teddy Bear

It remains for me to experiment with other effects or color correction to the teddy bear. I don't know, but I would like technical staff to do a webinar to teach me how to make my own effects and load them into Lens Studio.

Built With

• google-colaboratory
• lens-studio
• python