This software leverages the Microsoft Kinect 2 sensor to estimate and track the 3D skeleton of a human and map that onto an avatar. Using this software, a user can control any humanoid avatar, such that the avatar mirrors the user’s gestures in real time. Since this software is written in Unity, you can easily place an user-controlled avatar in any scene.

Female avatar

We combined this with augmented reality tools for Android (Vuforia), to project the avatar as a hologram into the real world, as perceived by the cell phone’s camera. Since this project was written in Unity, it ports easily to any platform.

Vufonia AR

HoloScreen: Kinect Avateering in Augmented Reality!

Share this project: