Edu Sign (MVP)
Edu Sign is a free mobile app that translates real time speech into text and sign language GIFs. It was built using MIT App Inventor. It does not require any internet nor uses any cloud storage.
Inspiration: In a world where classroom conversations move fast students with hearing or speech impairments are often left behind. While exploring the theme of Ethical AI in Education, I realized that there aren't enough accessible tools to bridge the gap between spoken instructions and sign language in real time. I wanted to create a solution that was simple, portable, and didn’t rely on heavy data or internet so Edu Sign was born.
What It Does: Edu Sign listens to real time speech, instantly converts it into text and displays relevant sign language GIFs based on detected keywords.
Features:
- Speech to text conversion
- Automatic sign language GIF playback
- Offline compatibility
How I Built It: a) MIT App Inventor: Used for rapid prototyping and development
- Speech Recognizer: Converts spoken input into text
- Player Component: Automatically plays GIFs representing common phrases in sign language
- UI Design: Crafted with clean color palettes, welcoming screens, and simple navigation between components
- GIFs: Curated set of sign language animations in ASL
Log in or sign up for Devpost to join the conversation.