Inspiration
My inspiration came from the desire to build something that can help others use their laptops hands-free. The goal is to make anyone's computer accessible to them.
What it does
It reads hand gestures and motions to execute simple commands, like opening a browser or minimizing a window.
How we built it
OpenCV was the predominant tool; we also used the Claude API Opus model for screen-to-text translation.
Challenges we ran into
Fingers are hard to track for the humble computer. The biggest issue that still remains is having it perform at crucial moments.
Accomplishments that we're proud of
Finding ways to achieve common ground between what it reads and how I want it to read me.
What we learned
OpenCV is such a versatile tool. Using today's technology, it is so much easier to improve your experience with your computer and help other people's experiences improve!
What's next for Daena
I hope to add more features to help improve the user experience