SpeakEase

Empower voices with SpeakEase: a MR app for those with speech disabilities. Gesture tracking synthesizes speech, fostering inclusive communication in a seamless, immersive experience.

Comment

Inspiration

In the silent struggle against paralysis, my grandma lost her voice and also the freedom to move. Witnessing her isolation, I embarked on a mission. Using innovative body and eye tracking, I developed a lifeline—a transformative tool that reconnects her with the world. Harnessing body, hand, and eye tracking, I created a tool transcending mere communication. It's a gateway to new independence, enabling you to confirm, navigate, and actively participate in the world by expressing opinions. This innovation strives to redefine the boundaries of her abilities, providing a comprehensive solution that enhances her overall quality of life.

Empowering Communication through Mixed Reality

Overview

SpeakEase is an innovative Mixed Reality (MR) application designed to provide a comprehensive communication solution for individuals with speaking disabilities. The app aims to become a standard preinstalled application for PICO devices, ensuring widespread accessibility. SpeakEase goes beyond speech synthesis; it incorporates hand gestures, visual feedback, and even supports sign language learning.

Features

  1. Basic Communication Module: Speech Synthesis: Utilize basic body and hand gestures for speech synthesis, enabling users to communicate effectively. Visual Feedback: Integrate visual cues for enhanced communication, catering to users with varying degrees of disability. Preinstalled on PICO Devices: Ensure SpeakEase is a default application on PICO devices for seamless accessibility.
  2. Gesture-Based Interaction: Hand Gesture Recognition: Enable users to navigate and communicate through intuitive hand gestures. Mute Person Support: Extend functionality to cater to mute individuals, facilitating communication through expressive hand gestures.
  3. Sign Language Learning Module: Interactive Lessons: Provide interactive modules for learning sign language using the app's gesture-tracking capabilities. Progress Tracking: Include a feature to monitor and track the user's progress in learning sign language.
  4. Advanced Communication Module: Eye and Head Tracking: Implement advanced eye and head tracking for users with more complex cases of paralysis, allowing precise control over communication. Customizable Settings: Offer flexibility in adjusting tracking sensitivity and other parameters based on individual needs.

User Interface (UI):

Intuitive Design: Ensure a user-friendly interface with large, clear icons and customizable settings. Visual and Auditory Feedback: Incorporate visual and auditory feedback to enhance user experience and aid interaction. Accessibility and Inclusivity: Customizable Profiles: This allows users to create and save personalized profiles with customized settings. Language Support: Provide multilingual support to cater to a diverse user base.

Conclusion

SpeakEase aims to revolutionize communication for individuals with speaking disabilities, becoming a standard on PICO devices. It not only provides a lifeline for those with communication challenges but also serves as an educational tool for sign language, promoting inclusivity and accessibility on a global scale.

Built With

Share this project:

Updates