Inspiration
Deaf and hard-of-hearing children often miss spoken coaching instructions during team sports, creating an information gap rather than a skill gap. Cue was built to make coaching accessible through real-time visual communication.
What it does
Cue converts a coach's spoken instructions into instant visual cues on a player's device. Using speech recognition and real-time synchronization, it displays commands like Press, Cover, or Pass with player names or jersey numbers.
How we built it
Built with Flutter, Firebase Realtime Database, Speech-to-Text, and Provider. A custom command engine performs text normalization, player resolution, intent recognition, and confidence scoring before synchronizing accepted commands to the player's device.
Challenges we ran into
Handling natural coaching language, reducing false positives, maintaining continuous speech recognition, and ensuring only high-confidence commands reached players in real time. Accomplishments that we're proud of Built a working real-time accessibility platform with an explainable command engine, responsive Flutter UI, and low-latency communication between coach and player devices.
What we learned
Accessibility solutions must prioritize reliability and user trust. Delivering fewer but accurate cues is more valuable than displaying incorrect instructions.
What's next for Cue
Add customizable team rosters, multilingual support, secure authentication, offline communication, smartwatch/haptic feedback, and AI-powered command understanding to support more sports and larger teams.
Log in or sign up for Devpost to join the conversation.