“NeuroScribe” is a tool that harnesses EEG waves for mood and speech communication, giving voices to individuals who have lost it. There are many disorders that impact motor neurons across the entire peripheral body, impairing fine and gross motor control from walking to speaking.
Take “Davie” for example. He was diagnosed with Amyotrophic Lateral Sclerosis (ALS) and gradually lost all motor function, including the ability to walk and speak. He didn't just lose his ability to communicate; he also lost his ability to make facial expressions. A lot of patients report that they feel their identity and self expression is hindered with diagnosis that impair their independence.
We aren’t creating static text, but emulating the different dimensions of interpersonal communications such as facial expression, utilizing mood detection. Firstly, mood will be displayed to the listener, allowing individuals that lack the ability to convey tone and expression to do so. Mood detection also serves as a precursor to speech creation, allowing us to design a swifter and more efficient interface by predicting words tailored to the detected emotional state. Specifically, three models will be created, representing negative, neutral, and positive moods.
Word selection will be completely hands free, as a third model will recognize imagined directional cues. The user will only need to imagine pushing the letter block on the screen "up," "down," "right," and " left," towards a selection, making the interface accessible for all levels of motor impairment.
Log in or sign up for Devpost to join the conversation.