We wanted to allow people to explore other ways to interact with a virtual environment
What it does
The player can interact with a ball and attempt to avoid obstacles by using hand gestures
How we built it
We used the JMonkeyEngine to create the game environment, using AppState, along with the LeapMotion SDK to process a player's hand gestures as input.
Challenges we ran into
Getting the LeapMotion to recognize gestures is challenging, as it updates itself very rapidly and can recognize a lot of gestures in a very short amount of time. It is quite difficult to figure out when a player performs an intended gesture and ignore any other unintended motions. We also have to then translate the gesture into an action that is performed in the virtual environment.
Accomplishments that we're proud of
It works !
What we learned
We learned how to accurately predict a user's intended gesture using leap motion, and we learned how to create a simple virtual game environment using JMonkeyEngine
What's next for MotionJumper
We hope to further the interaction between the real world and the virtual environment by providing a closer link between a user's actions and the output in the environment.