🚀 Inspiration We were inspired to make communication more inclusive by enabling automatic translation of text and gestures into sign language using computer vision — helping bridge gaps for the deaf and hard-of-hearing community.
💡 What it does Sign Language Creator is a Python-based tool that:
Converts spoken or written text into animated sign language
Detects and interprets hand gestures using real-time webcam input
Visualizes sign language gestures using 3D animations or on-screen overlay
🛠️ How we built it YOLO for hand and body detection
MediaPipe for precise hand landmark tracking
OpenCV for frame processing, gesture visualization, and UI
Python as the core language for integrating all components into a single pipeline
🧗 Challenges Gesture recognition accuracy in varying lighting and hand positions
Matching text to correct sign sequences
Real-time processing and frame-rate optimization
🏆 Accomplishments Functional real-time sign translator from text and gesture
Fully Python-powered with no heavy frontend frameworks
Modular pipeline that’s easy to expand
📚 What we learned Real-time hand tracking can be highly accurate with MediaPipe
Combining YOLO and OpenCV allows for fast and effective visual recognition
Even lightweight Python scripts can power impactful accessibility tools
🔮 What’s next Add support for different sign languages
Improve detection under diverse conditions
Add voice-to-sign and sign-to-text modes
Package as a desktop app or browser-based tool via WebAssembly
Log in or sign up for Devpost to join the conversation.