-
Design
Inspiration
We discovered the library PoseNet not too long ago and it seemed like an amazing tool to be creative. So for this hackathon we prioritized creativity rather than sophisticated looking algorithms. We wanted to learn, create and have fun!
What it does
This game aims to replicate the experience of Pictionary. Make your friends try to guess your drawings! But this app does not require pen, paper or even a touchscreen! Only a camera (webcam) and your hands! By moving your hand in front of the camera, PoseNet detects its position and we mapped these to actual drawings. Plus, you can play with your friends online.
How we built it
We used JavaScript for the mapping. HTML, CSS for the web app and Firebase to keep the database.
Challenges we ran into
To make the drawings more precise since PoseNet ML was not that efficient at identifying and tracking wrist movements
Accomplishments that we're proud of
The style of the web app (for the designer it was her first time working with HTML and CSS), and that we greatly improved the accuracy of the drawings.
What we learned
HTML, CSS, PoseNet library, JavaScript (different for each teammate)
What's next for PoseArt!
More interactive activities, colours, and maybe an adventure mode! Also, we want users to be able to share their chef d'oeuvres on Instagram, Facebook and Tumblr. (Maybe even add a ML algorithm that would try to guess your drawings.)
Log in or sign up for Devpost to join the conversation.