Operating system for specially abled people

Inspiration

As technology is evolving everyday,everyone should have equal access to the technology and its benefits and as a lot of specially abled people can’t use the technology in their real life like normal people do, which makes them feel disconnected from the world and increase in depression and suicidal tendencies.

What it does

we use camera / webcam to track eye or facial moments to use the functions of operating system which uses artificial intelligence and machine learning to understand users inputs for example :- taking mouse input from where the eyes are looking and using blinks, sequences of blinks or actions of facial mesh,hand gestures to execute a certain command and also integrating voice assisted commands for most of the tasks which would make it more easier for the user to navigate and having special features integrated according to the disabilities which would grant the user the access to technology to much greater extent and even in some special cases brain signals directly can be used to read the user's input and what he wants to achieve with the help of deep learning and neural networks to help him with the basic tasks.

How we built it

there are features in accessibility option of windows but which aren't that useful for a user with disabilities and doesn't give them any advantage but our system can be used in android or windows by just using the webcam ,microphone of laptop or selfie camera of mobile. which does not include any extra cost for hardware and also makes it much more accessible to people. We used artificial intelligence , machine learning to recognize the facial moments and patterns of the user and the functions could be mapped and calibrated accordingly.

Challenges we ran into

laptops aren't built with high resolution webcam which makes it harder to generate facial face mesh and to recognize the actions.

Accomplishments that we're proud of

We have made a system which would help millions of people to use computers in a way easier way without any extra cost.

What we learned

we learned how to train machine learning models and using computer vision.

What's next for Operating system for specially abled people

With proper support,technology and studies we might be able to map the brain signals into particular categories which would make it easier for the patients to control it directly with just using the brain.