The idea comes to our mind while talking with Logitech about their disruptive new lineup of products.

What it does

Our pice of code is capable of analyzing images from the webcam and detect a human face, track eyes and mouth to estimate the level of stress and fatigue of the user and suggest him/her to take a break to increase productivity or learn a better way to complete a job like using our system of shortcuts (by sending user notifications on their system).

How we built it

We used the opensource library OpenCV that provided us with pre-trained models to recognize the user's face. We worked with Python to design our own algorithm to detect yawnings and blinkings and calculate the level of fatigue of the user. We worked in parallel on key detection and short-cuts personalization using LabView that allow us to create an executable that is intuitive and with a simple user interface.

Challenges we ran into

The main challenge is learning how to set up the project to use Logitech API, how to create a well-performed face detection program that can detect correctly and fast in a real-time scenario.

Accomplishments that we're proud of

We created a very stable and good real-time face recognition system and a great program that offer a totally different experience in line with Logitech products.

What we learned

What's next for FlashDev

Our vision for this software product is to be implemented in all operating systems in order to give the freedom to the user to create great personalized short-cuts and to improve quality of life by reducing stress and prostration. Moreover, we want to leverage the built-in proximity sensor of the MX keys plus keyboard (unfortunately it is not publicly available yet) to increase the productivity of the user in terms of input/time.

Built With

Share this project: