The minority report movie, as well as a demo from a leap motion developer who made a similar system.

What it does

It is designed to augment one's desktop by displaying windows as if they are floating in mid air in front of them.

How we built it

We used the unity engine and C# scripts, with Windows API calls.

Challenges we ran into

Grabbing and writing the windows into memory efficiently was very difficult as was properly updating them. The Leap motion Orion SDK has very little documentation.

Accomplishments that we're proud of

Hand writing the leap motion gestures and getting the window textures into unity.

What we learned

Don't use Unity for Windows API

What's next for AR Unity

A C++ version using OpenGL

Share this project: