Inspiration

Not being able to use a keyboard or mouse should not prevent someone from accessing the internet and computers in general. We sought to bring computing to people who would be physically incapable of it using traditional methods.

What it does

Merlens uses computer vision and natural language processing to process a user's facial positions and allow them to interact with their computer via head movements. One simply needs to move their head in the direction where they want the mouse to go and Merlens will move the mouse there, hands-free. Similarly, with a long blink users can click to navigate around their computer. We use speech-to-text processing to allow users to speak text to the computer for those who cannot use a traditional keyboard.

How we built it

Merlens uses computer vision and natural language processing, implemented in Python, to provide accessible computing to everyone.

What's next for Merlens

Developing more ways for motion-impaired users to interact with their computers.

Share this project:

Updates