Has anyone ever wanted to a holographic augmented reality room like tony stark? So did we. After an intense night of brainstorming and inspiration from Marvel's genius, billionaire, playboy, and philanthropist Iron Man, we tried to implement a sliver of the futuristic technology we see him use. In our case, we used a Leap Motion controller and Python to capture motion into something tangible and realistic so that we could experience what it would be like to have control of your virtual reality at the palm of your hands.

What it does

It provides a virtual whiteboard environment controlled using Leap Motion, which captures finger motion and hand gestures.

How I built it

Python using Leap Motion SDK, interface with Pygame

Challenges I ran into

  • Learning Leap Motion SDK
  • Making the gestures to work the way we want them to
  • Hand motion detection is wonky on the hardware side

Accomplishments that I'm proud of

Implemented hand and finger gestures to draw

What I learned

Leap Motion SDK, Python

What's next for Air Canvas

Holographic augmented reality environment like we see in Iron Man. In your very own room you can interact with holographic augmented reality like Tony Stark without the need to wear special glasses or heavy gear. In education, accessibility and leisure. We can expand into integrating machine learning and augmented reality and virtual reality if users wish to use it with their Vive or Oculus. There is an opportunity to expand to be used as an accessibility technology. People with an unsteady hand or need more area to write can use this app, or if they need help to draw to articulate what they want to say, we give them a platform to do so.

Share this project: