Inspiration
We wanted to make learning American Sign Language (ASL) more fun, accessible, and interactive. Inspired by Duolingo, we created a gamified platform that makes learning sign language engaging for everyone.
What it does
ASLingo helps users learn ASL through interactive lessons, real-time hand gesture recognition, AI-powered feedback, and fun games. Users can track their progress, earn points, maintain streaks, and compete with friends.
How we built it
We built ASLingo using React, Vite, and JavaScript for the frontend, Node.js and Express for the backend, MediaPipe for hand tracking, and Google's Gemini API for AI-powered feedback and personalized learning.
Challenges we ran into
Our biggest challenges were accurately detecting hand gestures, providing real-time feedback, integrating AI, and creating a smooth, engaging user experience under hackathon time constraints.
Accomplishments that we're proud of
We're proud of combining computer vision, AI, and gamification into an interactive ASL learning experience. Building a platform that makes learning more accessible while keeping it fun was our biggest accomplishment.
What we learned
We learned how to integrate computer vision with AI, handle real-time interactions, collaborate as a team, and rapidly develop a full-stack application.
What's next for ASLingo
We plan to expand our ASL vocabulary, improve gesture and facial expression recognition, introduce a realistic 3D signing avatar, and develop more multiplayer games and personalized learning features.
Log in or sign up for Devpost to join the conversation.