Depth Desktop

• 

  Desktop navigation UI

• 

  Eye tracking visualization

Inspiration

We wanted to challenge ourselves to see if we could make an easy-to-use, navigable desktop you don't need hands to control.

What it does

Allows user to use head movements with the facecam to control the desktop

How we built it

Using the mediapipe python library to track where the eyes are with respect to the camera and connecting the data to our frontend to control the menu

Challenges we ran into

We wanted to do more with blinking for selection but found it would be difficult to consistently determine when the user blinks from a distance. We also had some trouble expanding into some 3D features we wanted to implement.

Accomplishments that we're proud of

Getting head tracking to work, having fun, and putting together something we're really proud of.

What we learned

Connecting different visual python packages can be difficult. Always plan accordingly

What's next for Depth Desktop

Fun 3D desktop wallpaper that moves based on head location.

Built With

• mediapipe
• python