Touch the Silence World

Unity Interface (developing)
Game Scene
Test Leap-Motion System
Game Scene
Music Composition Software

Inspiration

Touch the Silence World is a 2D video game that is coordinated with the leap-motion system. When our team realized the capability of leap-motion on tracking hand movements, we decided to use this system to create a video game that helps the learning of sign language.

What it does

In the game, the player needs to learn from the character in the game about the meaning of each gesture and perform those gestures to solve the puzzle. By observing the action of NPC, the player gradually learns the meaning of the gesture in the game, and their palm movement is captured by the leap-motion device. The purpose of this design is to not only to learn the knowledge of sign language but most importantly, to build a bridge between normal individuals and disability people. We want the player to feel a world without voice.

How we built it

The game is built on the Unity engine with C# language and use leap-motion to capture the finger movement to check if the player performs the right gesture.

Challenges we ran into

The Unity engine has some unstable conditions, such as crash or fail to load script. Our team needs to repair and rebuild some of our work. Also, there are only a few resources for leap-motion on Unity, our team needs to learn from scratch and build our own algorithm to read finger.

Accomplishments that we're proud of

Great interaction between game and player and mature recognition algorithm.

What we learned

We have learned more mechanism of Unity engine and some video level design skills. Also, we have learned how to build leap-motion algorithm in C# language.

What's next for Touch the Silence World

We plan to extend the worldview of the game, introduce more characters and more levels of the game if the public found interested in such a mechanism.