What it does

AskarVision will track your eye movements and find where you are looking at on your computer screen.

How we built it

We built it with Python using OpenFace and Tensorflow. OpenFace analyzes pictures of the user that are taken whenever the mouse is clicked. The user is typically looking at the mouse cursor when they click, so we use this method to gather the training data. We put it through Tensorflow which created a useable model for predicting where the user is looking on the screen.

Challenges we ran into

Getting everything set up took a long time, and Tensorflow was very difficult to work with. It took a lot of trial and error.

Accomplishments that we're proud of

We actually got a working classifier from Tensorflow by the end. It was rudimentary, but it has a lot of potential to be improved greatly in the future.

What we learned

Tensorflow is hard.

Built With

Share this project: