Inspiration

Ever felt like a shrimp ๐Ÿฆ hunched over your desk? Us too. That's why we created Sit Happens!

What it does

Sit Happens monitors your posture using your webcam. If it detects you slouching or leaning awkwardly, it immediately pops up a window to roast you for it. There are also options for other desk habits like not blinking enough. The witty comments are designed to encourage better posture, blending humor ๐Ÿ˜‚ with helpfulness.

How we built it

We used OpenCV to access the webcam for real-time video input. For the blinking detection, we used MediaPipe to map the facial landmarks and calculated the Eye Aspect Ratio (EAR) to determine blinking patterns.

For posture detection, we trained our own machine learning model using Convolutional Neural Networks (CNNs). The model analyzes user-provided data to detect posture deviations. We used Tkinter to create the pop-up windows and Gemini to generate roast messages and compliments.

Challenges we ran into

Integrating all the components into a cohesive system was quite challenging, especially within the limited time frame. We initially faced difficulties with OpenAIโ€™s tools, but we pivoted to Gemini, which turned out to be a reliable alternative. Training the machine learning model also required meticulous adjustments to achieve a high level of accuracy.

Accomplishments that we're proud of

We are incredibly proud of successfully:

  1. Designing and training our own machine learning model.
  2. Seamlessly combining technologies like OpenCV, MediaPipe, and Gemini.
  3. Crafting an innovative and humorous approach to encourage healthier desk habits.

What we learned

This project taught us how to incorporate generative AI into our workflow effectively. It was also our first time training a machine learning model, which deepened our understanding of data preparation, modeling, and accuracy tuning.

What's next for Sit Happens

We aim to expand Sit Happens by incorporating additional features to promote healthy desk habits, such as reminders for hydration, desk stretches, and screen breaks.

Built With

+ 19 more
Share this project:

Updates