Virtual Studio

• 

  Main Screen

• 

  Menu

• 

  Setting

Inspiration

During this post-pandemic period, many trainers or performers have their classes or shows in social media. So we create an app called Virtual Studio to help them making virtual avatar show quickly.

The app has Android, PC and Mac version. More info would be found here. https://softmindtech.wixsite.com/vtuber

What it does

Users would control the avatar head by their webcam and some motions by hotkeys. Users would also control avatar lip movement by microphone. They would record the video during their shows and insert different medias (e.g. photo, video) during capture.

And there are pre-built 3D props and VFX effect in the app. So they would drag it for their need during capture. Microphone and both other sound effects are all captured in the production video.

How I built it

I am using Unity and different other plugins to make all software functions.

Challenges I ran into

The face detection in real time is quite difficult to implement in the app. I try hard to figure out the correct solution.

What's next for Virtual Studio

To import Bitmoji 3D avatar from Snapchat To let user customise their virtual avatar, import their VRM model (3D humanoid avatar format) and import 3D models from Sketchfab

Built With

• unity