Roar

• 

• 

• 

• 

Effect ID

478996369351510

Video recording of the effect (updated)

https://www.youtube.com/watch?v=Ku30N9rRH4g

Inspiration

Majority of ALS patients in developing countries are deprived of sophisticated techniques of communication due to financial reasons. Eventually, They lose their battle to ALS without ever having technology by their side.

What it does

With its intuitive User Interface and eye gesture based navigation, Roar allows ALS patients to communicate using just their smartphone without any prior training. Roar uses a collection of 6 categories, each category containing 5 words or emoticons.

As soon as the effect detects a face, a list of words or emoticons from a particular category is displayed.

Patients can cycle through different words or emoticons of a particular category by just blinking their eyes.

They can cycle through different categories by just closing their LEFT or RIGHT eye for 1 second.

To communicate a particular word or emoticon, patients have to close both eyes for 1 second.

This will display the confirmed word or emoticon inside the green rectangle present at the top and also plays a sound.

UPDATED SUBMISSION

1) UI Redesign : In the previous version, the effect used to take up a lot of space on the screen and overlap on top of the patient’s face.

To avoid this, the UI elements have been placed at the extreme left so that the patient’s face receives maximum visibility when the effect is being used to communicate with a friend during a facebook LIVE session.

The effect now has a home screen with a list of features. patients can cycle through different features by just BLINKING their eyes.

To navigate to a particular feature, patients have to CLOSE BOTH EYES for 1 second.

2) Keyboard : The effect allows ALS patients to type by just blinking and this is achieved with a completely new keyboard layout.

The layout contains 10 rows, each row containing 3 keys.

Patients can cycle through different rows by just winking their LEFT or RIGHT EYE.

From a selected row, patients can select a particular key by just closing their LEFT or RIGHT or BOTH EYES for 1 second.

3) Game : The effect allows patients to play a simple Quiz which requires a lot of thinking.

patients can cycle through different choices by just blinking their eyes. They can confirm their choice by CLOSING BOTH EYES for 1 second.

Patients can at any time go back to the home screen by CLOSING BOTH EYES for 3 seconds.

How I built it

Using Spark AR

Challenges I ran into

-Shortlisting the top 20 words and 10 emojis for the effect

-Simplifying the UI and designing the effect to work based on user's eye gestures

-Differentiating between eye gestures

Accomplishments that I'm proud of

Roar effect has been approved by Facebook.

What I learned

As a designer, i learnt about 3D files, shaders and textures

As a developer, i learnt Patch Editor, Reactive Programming

What's next

-Word prediction

-More words and Emojis

-Instagram Approval of the Effect

-Popularizing it among ALS patients

-Speech audio to be played for each word

Built With

• spark-ar