Inspiration

Combining Myo technology and android development, Flick aims to assist basic everyday communication for the verbally impaired.

Inspired by Sign Language and brought to life by the Myo armband, Flick embodies technological advancement in communication for the vocally impaired.

What it does

Consider a verbally impaired person enters a coffee shop and would like to make a simple order of coffee. Most people will not be able to understand Sign language thus leading to awkward and embarrassing attempt to convey what they want.

This is when Flick comes in.

Using the Myo armband, Flick allows users to map simple gestures to custom key phrases. Upon recognizing those custom gestures, the Myo will access the users phone, and let the phone speak on their behalf. Flick can be accessed, initiated and used directly from the Myo, allowing for seamless everyday communication.

How we built it

We used the Myo armband with custom gyro calibrations to maximize the different combinations of phrases available to the user. We connected the Myo to a native android app and mapped distinct gestures to phrases and then to speech using a text to speech engine.

Challenges we ran into

The Myo is a relatively new technology and as such, it has its limitations. We experienced difficulty with calibrations, leading us to design our own custom calibration.

What I learned

We learned and explored the limitations and boundaries of Myo. We experimented with different technologies such as LeapMotion and Pebble.

What's next for Flick

We're experimenting with increased gesture accuracy, leading into expanding our possible gesture base. Furthermore, as the Myo technology evolve, we aspire to start mapping the ASL (American Sign Language).

Built With

Share this project:

Updates