PLEASE WATCH VIDEO IN 2X speed, we were talking a bit slow
Thank you very much!
Inspiration
The two of us have always been passionate about ergonomics; whether it was how our monitors are positioned or what types of succulents are the best, we thought it would be really neat to build something though a product-focused lens that also helps other people improve their health and productivity, especially in these past few months where many people are working from home
What it does
Ergen-Dazs allows people to take a picture of themselves to calibrate a model that detects how far their face is from the screen in real time. In accordance with ergonomic best practices, it enables people to adjust their desk setups.
How we built it
We took some time to plan out the features we wanted and make a mockup (https://www.figma.com/file/8hd6Y7MPHtAgWKH3epsRqY/Hackathon---Ergen?node-id=2%3A5814). We built this by using tensorflow.js to constantly detect people's faces by following the around in real time. The front end was created using React.js, while we added additional functionality through firebase that allows people to save their calibration shots to their google account so they don't have to take it again.
Challenges we ran into
We ran into a lot of troubles with fine-tuning the face detection - it was often very laggy and we made constant optimizations to increase the accuracy. Other challenges involved bringing all the parts together - we worked with a lot of asynchronous functions, which often made it tricky to coordinate front end animations, database queries, and the constant computations that were done in the back-end to identify faces.
Accomplishments that we're proud of
We're proud of working with computer vision and firebase (which neither of us were very familiar with), and integrating it into a successful web application. We took a lot of time to think about the user experience and we believe that we created a very intuitive and pleasant design to accompany it
What we learned
We learned a lot about user design, planning architecture from scratch, new technologies like tensorflow and firebase, and also the tenacity that comes with problem-solving and debugging.
What's next for Ergen-Dazs
We hope to keep working on this to further improve the user experience as well as adding other features like identify posture and eye level.
Domain Name (Shoutout domain.com)
ergen-dazs.tech <------ (like the ice cream lol)
Built With
- firebase
- javascript
- node.js
- react
- tensorflow.js
Log in or sign up for Devpost to join the conversation.