When browsing the internet, people with vision can give a quick glance at a website and know where everything is. However, for the blind and the visually impaired, even with existing software, browsing the internet is much harder. Currently available software like VoiceOver try to overcome this problem by transmitting the information by speech, which works well for websites with simple design and a lot of text such as Wikipedia. However, for websites with complicated design and graphical components such as social media sites, it is nearly impossible for the visually impaired to know where everything is in a short period of time.
Our application uses a leap motion as a way to track finger movements and then use the information to map the 5 fingers to 5 separate cursors. When the cursor is hovering over a certain web element such as a button, image, or link, tactile feedback is given back to the user in a special glove that is worn. Therefore, each finger receives different tactile feedback depending on where and which element it is currently hovering on, providing a quick way for the blind to get accustomed to the layout of the website.
When combined with current technology that allows reading of different components, this can possibly be a new and better way for the blind to browse the internet.