Inspiration
Our inspiration for this project comes from our desire to code something that reads user input from something unique, and we decided on the translator due to our knowledge in the ASL alphabet.
What it does
Our project accesses a user's webcam and uses MediaPipe to find the 21 points in order to read each letter and save them for when a user signs them on camera.
How we built it
We used MediaPipe to read the 21 points in our hands when signing each letter in the alphabet. We took data from multiple people in order to hopefully have the most accurate translator we could.
Challenges we ran into
The biggest challenge we ran into was getting the software to correctly read each signed letter. When we ran the software the first time, it was struggling to be able to read each letter, and it was a challenge to get it to type out what we wanted.
Accomplishments that we're proud of
We're proud of the fact that we were able to make a running and functioning program for our first hackathon on our own.
What we learned
We learned more about how to create a project in VSCode and more about how to collect data and implement it into the functionality of what we want/
What's next for Hanext
We were considering finding a way to make it accessible to the public with a double-click app. We would like to find a free or cheap domain and upload our project there. Our intention is more to have this project as something we can add to our resumes and potentially turn into personal projects.
Log in or sign up for Devpost to join the conversation.