More of us should learn how to sign. However, tools and systems for learning sign languages are underdeveloped compared to those for studying spoken languages, especially online ones. Therefore, we made AreoASL to make learning ASL online more accessible and fun. In particular, we use computer vision to provide real-time feedback on the user's signing skills, providing much needed feedback that's hard to get when you are learning virtually on your own.
How we built it
We built a real time object detection model using yolo v5 and Pytorch.
This was my first time working with deep learning and training a custom real time object detection model. From learning how to select data to implementing the model on the web, it was an incredibly challenging but also eye opening learning experience