IronmanAR

• 

  Transform yourself into Ironman

• 

  See yourself with Jarvis Interface

• 

  Lock on the target

• 

  Fire the laser

Inspiration

Have you ever thought about wearing the Iron man's suit? Will we be able to become the Ironman if we’re wearing the Ironman suit? If so, how could the suit augment your abilities in the actual world? Those sorts of questions led us to imagine wearing the Ironman suit through AR, and we wanted to give opportunities that users gain the Ironman’s superpower in their daily lives and have fun moments with their friends.

What it does

IronmanAR is a face effect that users are able to shoot a magical laser to another's face. Using face recognition on the face-facing camera, you are able to wear the Ironman’s suit that includes the shooting ability. Afterward, you need to use the backside camera by switching a camera in order to shoot the magic laser to another’s face. When you tap and hold on the screen, the laser will be launched on the detected face of the cute daily enemy. The embedded face landmark will recognize the detected face to apply magical effects through AR laser.

How we built it

As for the suit-wearing scene, we have imported a green screen processed png sequence and replaced its face part with the user's face which is animated along the sequence. Next, we used body segmentation and made the background very dark in order to show the user's face is inside of the suit. Lastly, we added a face tracked HUD (head-up display) and synchronized the rotation with the user's face.

The laser of the back-facing camera is triggered by long-pressing anywhere on the screen and made with the built-in particle system. For the face dividing effect when the laser is hitting the target, we previously divided a typical face mesh into the top and bottom part in Blender and exported so that we ended up animating each part of the head differently and added supporting png sequences for the explosion effect.

Challenges we ran into

Since we were running hundreds of images and audio files like wearing the suit, HUD, and explosion, putting everything in a limited space was a big deal. We had to try using different PNG image optimizers several times for converting the PNG images into the smallest size and finally succeeded to modify the color bit precisely.

Accomplishments that we are proud of

Our team has been focusing on the storyline in a certain context, unlike the other AR function. Beyond the facial effect, our idea has a context that is broadly being used and the generally happening situation in our daily lives. We believe that those attempts make this service a more user empathic AR service with familiar hero characters. This sort of storytelling driven AR effect will facilitate users to use the service more enjoyable and richly with others in various situations.

What we learned

With the first time of developing a Spark AR project, we have learned most of the basic features of the software such as managing patches, grouping and layering, animating assets and sequences, handling custom instructions, scripting Javascript and bridging with the patch. 3D editing skill is a plus.

What's next for IronmanAR

For the next step, we are aiming to not only add various hero characters, weapons, and effects but also deal with the problems of human beings or our planet in a humorous way. Next characters: Captain America and Batman

Built With

• javascript
• sparkar