HeadsUp

A web and computer app which alerts users when they are maintaining bad posture, using visual recognition and machine learning.

Comment

Inspiration

In today's society, over 40% of children are diagnosed with bad posture. Every person is either on their computer, laptop or phone, looking down at their screens. The COVID-19 pandemic has exponentially increased the computer usage for both adults and students. This leads to great amounts of stress in the shoulders and can lead to health problems. This applies to both the school and corporate environments. To help solve this problem, I created this app that alerts a user when they are maintaining bad posture on their laptops.

What it does

It alerts a user when they are maintaining bad posture on their laptops by blurring their screen, dimming it, and playing an alarm.

How I built it

Using visual recognition, HeadsUp recognizes the different features of your face and measures the change in the nodes set at activation. I used the Tensorflow.js PoseNet model to recognize the posture on HTML and used OpenCV in Python.

Challenges I ran into

I was not very familiar with how to create a GUI with Tkinter in Python. This caused me some trouble; although the GUI is not as advanced, I had no idea how to use it. Alongside that, the training of my visual recognition model was failing periodically for unknown reasons which proved to be a setback.

Accomplishments that I'm proud of

Now I can use Python to create apps with a GUI. I am also proud of learning different Git commands which helped me with repository work.

What I learned

Persistence is the key to accomplishment!

What's next for HeadsUp

Implementation into everyday environments, such as in offices to provide possible healthcare benefits, analyze student engagement in classrooms, and later be able to diagnose certain diseases with data from this app. Not only that, but a mobile version that checks both screen time, and how close someone is to their phone.

Built With

Share this project:

Updates