Inspiration
We all have too many failed attempts at all nighters when we really needed. We decided to create something that would ensure we stay working all night.
What it does
Uses computer vision to locate landmarks on the eye, and using those landmarks we take the eye aspect ratio which is the two vertical distances added up and divided by two times the horizontal. Once the eyes close and remain closed, it will send data to the arduino to start a timer and after 10 seconds the buzzer will go off and after 20, the servos will move. If the eyes open anytime, it will reset the timer.
How we built it
We used computer vision in python and had a serial device library to communicate with the C++ code to then control the arduino accordingly.
Challenges we ran into
Software issues with the landmarks, finding the proper formula, various hardware issues regarding connecting to the serial port, Wanted to add a spray mechanism but limited due to resources.
Accomplishments that we're proud of
We are proud of learning the computer vision and dlib library and managing to incorporate hardware in the project.
What we learned
Machine learning requires a lot of trial and error and how to work with arduinos and computer vision.
What's next for RU sleepy?
We would like to add a water spraying mechanism so the user wouldn't have to refill the cup. We would also like to add a posture sensor to the computer vision code so that the user will maintain proper posture while working.
Log in or sign up for Devpost to join the conversation.