Hand Gesture Password

Learning skin color
Hand is recognized
Login success

Inspiration

For the Charles Schwab challenge. I stuck with the password bypass prompt at the opening ceremony and the only password bypass implementation that hasn't been used frequently was hand gestures

What it does

Bypasses text password by using hand gestures, similar to face ID and fingerprint scanning

How I built it

I implemented an API called Javascript Hand Gesture for the hand tracking, the hand placement is divided into 9 main sections and knowing that I implemented an algorithm to create a sequential array of the areas the hand is visiting (i.e. from bottom to middle to top then to left then right and so on). If a gesture sequence ever matches the password sequence, the user will login. Site was ran through a node.js localhost:8080 server (remember this if you wanna try it on your own because it has to be ran off a server and not locally!)

Challenges I ran into

Google Chrome does not allow javascript to create workers on non-https websites, Mozilla Firefox now has restrictions on media playback through Javascript in an attempt to streamline everything into HTML5, Microsoft Edge doesn't allow use of localStorage if running site offline locally