Pop Sign Learning

• 

  Can customize words you want to focus on learning

• 

• 

  Expansive Gameplay

• 

  Pre Game Tutorials

• 

  Interactive Gameplay

Inspiration

Learning sign language is hard, but learning it on your own is even more difficult and stressful. Like all languages, it is not mastered easily beyond a basic level. And Mastery often requires extensive exposure and practice. With the growing population of ASL learners, many people want an alternative method of learning the language using mobile applications. However, as of now, there aren't many free apps in the App Store that provides adequate ASL learning.

However, as of now, there aren't many free apps in the App Store that provides adequate ASL learning. On top of that, many ASL learners have expressed dissatisfaction with the apps currently available in the store, claiming that they are difficult to follow, inconsistent, non-interactive, and lack accuracy.

This is a critical problem that needs to be addressed since 90% of deaf children are born to hearing parents. Parents with no understanding of sign language have no ability to meaningfully connect or bond with their deaf child. And, Deaf children who do not learn sign language may suffer from language deprivation, limiting their potential for the rest of their lives.

PopSign will help the deaf community by lifting some of the restrictions and hardships in a hearing world.

Furthermore, according to the data, 47 percent of the US smartphone users are IOS users. Thus, we anticipate that by developing an iOS app, it will be more accessible and used by a larger number of people.

What it does

PopSign aims at making learning something super essential incredibly easy and fun to do. Once a player selects a level, they have a chance to practice signs that may appear during the game. After that, they can jump right in and start playing.

The game is simple. Players aim and shoot at a bubble that has the word shown in the video. The bubbles pop if they match, and two or more of them are hit. The goal is to clear all bubbles off the screen.

As players progress levels, they unlock new words. And, they can even customize the level later to include only specific words they might want to practice.

How we built it

Developed using Xcode to bring swiftly to iOS

Powered by the Unity game engine for cross-platform capabilities

Challenges we ran into

We used video assets that were created at Georgia Tech over 7 years ago and were connected to python scripts that made the code base huge and hard to trace. Although our C# scripts were only about 3,000 lines in total, the XCode Project we exported was > 4 Million lines of code.

What's next for Pop Sign Learning

The first major step forward is to integrate real-time sign recognition into the app via computer vision. We may experiment with the true-depth camera and employ currently ongoing research on Hidden Markov Models.

Built With

• c#
• objective-c
• swift
• unity
• xcode