We wanted to create a fun and immersive way of playing first person shooter games. We chose to use the Leap Motion to interpret natural gestures and movements as game commands to add a bit of extra fun to an existing game!

How it works

We used a local node.js server and the Leap.js framework to interface with the Leap Motion and track movements and recognize gestures. The server would then dispatch the appropriate keyboard and mouse click events to the operating system which would be then received by any game the user is running.

Challenges we ran into

The hardest part was figuring out how to correctly send mouse and keyboard events to the operating system so they could be captured by the running game. After enough trials and debugging we were able to find a solution.

Accomplishments that I'm proud of

We were able to accomplish all the goals we set out to make. We implemented gestures for moving the camera, shooting a gun, using a knife, and throwing grenades. All the gestures come together in a very natural and instinctive way to the player, making it super easy to jump right in!

What I learned

The Leap Motion SDK was very easy to integrate into our project. Five minutes after installing and setting it up we were able to start processing gestures with only a few lines of code!

What's next for Leap Gamepad

Expand it to work with more games!

Share this project: