Eye Controller

Inspiration

To make things both fun and mundane in the world of computers accessible to those who may have disabilities which prevent them from doing the things they love.

What it does

This project uses OpenCV's image processing abilities combined with dlib's AI facial recognition technology to allow a user to perform mouse clicks with their eyes, by simply performing a long wink. The ability to point your mouse with your eyes is also in the works, but as of the time of this submission, we were not able to complete that portion of this project. At the moment, the project is a scalable prototype which has limitless potential. Anything that you can do with your face, can be developed into this technology, and as we continue to build on what we started in this hackathon, we are excited to see what this will grow into.

How we built it

We built it using open source tools and tutorials to get a feel for the computer vision tools, and then molded those tools into the demands of this project.

Challenges we ran into

The biggest challenge we ran into was the time it took to work out the math behind mapping a person's eye in real time. Unfortunately due to time constraints, we were unable to include this in the submitted project.

Accomplishments that we're proud of

We are proud to say that this project is in a working prototype stage, and that is a major accomplishment in such a short period of time. We are also proud that we were able to learn so much about this incredible technology in such a short span of time.