While the mouse is widely used today, some people have disabilities or body disorders, making it difficult for them to use a mouse to control the cursor. Our goal is to help them use a computer normally. Therefore, we wanted to create software that allows users to control the cursor without their hands(with eyes and head). At the same time, it could be a more convenient technology for people who don’t have a mouse with them or are working in special environments (e.g. underwater, hospital, outer space)
What it does
IClick is software that allows users to control the cursor with their eyes and head. It generates an eye-tracking algorithm so that the camera detects their irises and moves the cursor according to a gaze estimation. To click, users only need a single blink.
How we built it
We used video input image data to detect the iris and the head. According to the data of the movement of the irises and the head, we made gaze estimations. Next, we mapped the gaze coordinates on the display screen. Finally, our product allowed users to move the cursor quickly with their heads and eyes, and click when blinking.
Challenges we ran into
It was difficult to give precise detection and accurate cursor movements that followed the user’s gaze. To tackle this problem, we changed the camera capture target to the head, so users could use their head to control the cursor. The results improved a lot. The cursor became easier to control, and it was able to move faster.
Accomplishments that we’re proud of
- IClick in general
- We were able to use our code to control a cursor with heads and eyes
- With IClick, we were able to make basic operations and even play games like chess, minesweeper
- We made an amazing website
- We made a wonderful storyboard
What we learned
How to use a computer camera to detect our head, hands, eyes, irises
What’s next for IClick
IClick predicts that we will have exponential growth due to the novelty of this technology and the help it can provide to the population. One of our future plans includes utilizing IClick in outer space. It isn’t easy to operate a computer in outer space. Without gravity, the astronauts need to hold onto things to keep them secure. Using computer mice could be dangerous in this case because astronauts have to spare one hand to use the mouse. By using IClick, astronauts can free both of their hands to hold onto equipment, so it provides a safer workspace. At the same time, the instability due to zero gravity can cause astronauts’ cursors to move to unwanted places when controlled. IClick’s eye and head detection allow astronauts to better control the cursor.