Inspiration
There are many people in this world who gradually become isolated from their environment. Eventually, the patient reaches such a stage when he is no longer capable to nurture himself and is completely reliant on others. However, this is where our project steps in.
What it does
We use gestures to control objects. Such as toggling lights ON/OFF, making phone calls etc. Our program also locates the current position of the user and then notifies the ambulance and also family members.
How we built it
Our project uses OpenCV to detect the gesture and the shape made by the gesture. The program then takes an image of the object the user is looking at which is then sent to the pre-trained inception model to be recognized. Depending on the recognized object an action is taken.
Challenges we ran into
The biggest challenge was recognizing the gesture and tracking the hand movement. It was also a challenge to choose the right pre-trained model.
Accomplishments that we're proud of
Completing the project successfully
What we learned
How OpenCV works and how to use pre-trained Tensorflow models.
What's next for Gesture 2 Control
Adding blink detection for paralytic patients who are paralyzed from the body.
Log in or sign up for Devpost to join the conversation.