One of our team members had worked with the Leap Motion at a previous hackathon, so we decided to give it another try and help people to learn sign language.

What it does

It allows the addition of hand signs to the program and then allows users to practice the hand signs by matching them within 3D space.

How we built it

We used the Leap Motion Unity SDK to track hand movements to store the hand signs and then match against them to practice.

Challenges we ran into

We had various troubles implementing the Leap Motion within Unity. Trying to set the positions and rotations of the hands stored in the library proved difficult since they were using a different base position and rotation than the Leap Motion hands.

Accomplishments that we're proud of

We managed to actually get a working proof of concept for the program.

What we learned

We all gained a better understanding of Unity and the Leap Motion interface. We also learned basic sign language overnight.

What's next for LeapLearning: Sign Language

We can expand on the hand poses that are stored within the program. Eventually we would like to add the ability to convert sign language to text and text to sign language.

Share this project: