Inspiration

Our primary inspiration for this project were the sponsors. As this is a Hackathon, we decided it would be best to adopt the theme of the event instead of working on something unrelated.

What it does

Our project is a web application at it's core but comes with a twist. It cannot be navigated using a mouse and keyboard. All the user interaction is done via gesture tracking and state control. The gesture tracking is powered by Leap Motions Controller which uses a set of cameras to achieve accurate finger, hand and arm tracking.

How we built it

The first thing we did was to split the project into its smaller components; namely the gesture recognition part and the web user interface part. 2 of us worked on the first while the remaining 3 on the later.

Gesture Recognition Leap Motion has created a variety of libraries that can be used to interact with the Controller. We used the one written in Javascript in order to make the interfacing with the website as effortless as possible. While working on this project we discovered that even though the controller has a wide range of "preset" gestures, we needed to add some new ones such as the whole hand roll (X - Y axis). We also discovered that while the technology is certainly impressive, it comes with some limitations. For example, some gestures appear to be more accurate than others and there were occasions where the Controller was picking up a lot of unrelated noise. The noise can be cancelled by keep track of how long each object has been in view for, but unfortunately we did not have enough time to implement this.

User Interface For the user interface we wanted to use as much available code as possible. The charts were generated using the Google Chart libraries and the financial data were taken from fixer.io. For styling, we used the Materialize CSS framework in order to make the website look decent with the least amount of effort possible.

Challenges we ran into

The biggest challenge we had was getting all the data necessary asynchronously while also keeping the performance at acceptable levels. Also, we found that it was difficult to get the sensor to work once we deployed our website to Azure.

What we learned

The Leap Motion controller is an impressive device and can have a wide range of applications

Share this project:

Updates