point&blink

Inspiration

Limited accessibility options for people with limited dexterity and fine motor skills, assists with multitasking, and bridge the gap between human intent and technological ability.

What it does

point&blink is an eye-tracking software that can be used for cursor control and selection. Features: - Smooth cursor movement via Iris tracking. - Left Click: Blink Left Eye. - Right Click: Blink Right Eye. - Pause/Resume: Press 'p' or double blink to toggle control (allows using physical mouse). - Exit: Press 'q' or close eyes 3 seconds.

How we built it

We used Python as our programming language and heavily utilized Google Gemini to create the shell of the program. Within the actual program, we relied on OpenCV to allow the program to access our web Mediapipe to create the wireframe of the face, and PyAutoGUI to connect the frame to the cursor. We used Affinity Vector Studio to create our logo and graphics, and Streamlit for the website.

Challenges we ran into

Having to troubleshoot and find out which version of Mediapipe would work with the program.

Accomplishments that we're proud of

Troubleshooting for the smoothing of the cursor, which versions of the libraries would work together, and how to easily pause and quit the program.

What we learned

We learned how to use and update libraries within our code and how they can greatly assist with the "heavy lifting of the code".

What's next for point&blink

We plan to broaden the accessibility of this program to assist with other tasks. For example, we could implement point&blink in point-and-click adventure games, digital art, and Virtual Reality settings.

Built With

• affinity
• gemini
• mediapipe
• opencv
• pyautogui
• python
• streamlit