Inspiration
Looking around, during this event, we saw many people distracted on their phones! But what if there was a website that alerted you to stop?
What it does
SnapShot captures an image of the user every couple of seconds to check on their productivity. An alarm goes off if they are caught slacking on their phone…
How we built it
We combined google’s Gemini generative AI with a real-time camera that is recording the user. Gemini analyzes the data and SlackShot gives a warning if a phone is visible.
Challenges we ran into
Getting started was the hardest part. It took time to come up with our idea, and features we wanted. All the features individually were not the challenge, but fitting them with each other.
Accomplishments that we're proud of
We first got the camera working which was a big step forward. And we successfully connected Gemini to analyze the live image feed. Our prototype detects phone usage and triggers a warning when needed & an alarm. We also collaborated really well as a team, especially under time pressure!
What we learned
We learned how to integrate real-time camera input with AI analysis. This taught us valuable lessons in breaking big ideas into small, doable steps; it helped to keep us on track. We picked up new troubleshooting skills, especially around API and hardware issues. Teamwork and communication turned out to be just as important as coding.
What's next for SlackShot
We want to make SlackShot be able to infer there being a phone out of frame judging off posture, facial expression, etc. And we will make it detect distraction more generally: not just by checking phone use. Additionally, we have considered a point system for staying on task as well as suggestions from the website to take a break when the user appears more fatigued.
Log in or sign up for Devpost to join the conversation.