Summary
Our AI-integrated website is a service that runs in a user’s background and sends a notification for the user to consider a break if their emotions reach over a certain threshold for an amount of time. We do this by utilizing OpenCV and Mediapipe to detect faces and capture image data which is then sent off to Hume’s streaming API every 60 frames for processing. Their AI then sends back emotional data which we then use to gauge a user’s “negative” emotion levels. Our service also offers a report generation system if a user would like to receive comprehensive reports on their emotional levels over the past day or week.
Stack
Python, Reflex, HumeAI, CockroachDB, OpenCV
Target Audience
Our goal is to help workers who spend long hours at their computers or even students who have to spend long hours on their computers doing schoolwork or other activities. As computer science students who spend long hours on computers ourselves, we understand how sometimes students can spend endless hours on their work with no break, increasingly growing more agitated or frustrated as things don’t go as planned.
Mission
As Computer Science students, we certainly understand the pressure and difficulties working within a stressful environment for long hours. Our primary objective is to help people maintain their mental health through similar situations by suggesting breaks when they clearly need them. By promoting healthy work habits we aim to improve our client's efficiency, enabling them to succeed in an environment of their choice. We hope our tool will help many prevent burnout from endless grinding on their work and also help maintain their long-term mental health.
Challenges
Using new tools such as Reflex served as quite a difficulty as we were lacking on a lot of documentation and had to consult the Reflex staff. Furthermore, due to unfortunate difficulties on Reflex's end with Docker images, our project is unable to be hosted in production and our video streaming is severely laggy.
What We Learned
Throughout our time on the project, we were able to experiment with technologies both familiar and new to us. We expanded our skills in computer vision and full-stack development, and discovered a new framework to establish both a frontend and backend in python with Reflex.
Privacy
We do not collect data on users for profitable purposes but only to assist in providing analysis for users to better understand their health.
Future Plans
We plan to expand support to mobile apps for portable usage of our service and also plan to implement more features such as optimized health letters for physicians.
Log in or sign up for Devpost to join the conversation.