Inspiration
We were inspired by the games that we play together. One game we play together is draw battle and we wanted to put our own twist on it so we created a game where we draw using our fingers instead of our mouse.
What it does
First you choose a category and it will give you a word from that category. Then you will draw it before the timer runs out. AI will guess your drawing. If you are playing solo then you will get a point if the AI guesses is and no point if now. When you are playing multiplayer, the AI will see how accurate your drawing is and compare accuracy between you and your friends. Accuracy is 0-10 points. At the end you will see how much points you get.
How we built it
My Kid Could Draw That is a React app built with Vite and an Express server. We wrote it in Cursor, using it to scaffold the screens, wire up hand tracking, and debug multiplayer. The webcam feeds MediaPipe's gesture recognizer: a pointer finger draws, a peace sign pauses, a fist erases, and an open palm opens the color wheel. The fingertip is smoothed and mirrored so the cursor follows the hand.
When a round ends, the canvas goes to the server. Sharp flattens and resizes the sketch, then Gemini returns three guesses and an accuracy score from 0 to 10, which becomes the points. Prompt words come from MongoDB. Multiplayer uses Socket.io: one player creates a room, shares a four-letter code, and everyone draws the same word at the same time while the server scores each drawing and keeps a leaderboard. Solo play uses the same canvas, guess API, and scoring.
Challenges we ran into
We were still learning how to create a project as a team and as we were trying to collaborate on the project in our own segments we ran into a lot of merge conflicts. Sometimes when we would pull from the pull request we would not get the same thing on our screens. We also had issues with limited API key request.
We had many logistic challenges with our web app. We would have problems with not being able to draw on the bottom of the screen because it needs to see your full hand. Another problem we had was the multiplayer function, because our webapp is locally hosted we could not host multiplayer games across different devices.
Accomplishments that we're proud of
We learned how to use computer vision for the first time and we thought it was super fun and cool to see it come to life.
What we learned
We learn how to code with AI assistance with the new technology that was given to us!
What's next for My Kid Could Draw That
We want to fully flush out the multiplayer option so that we can host it on multiple devices, we also would like to fix how we cannot draw at the bottom of the screen.
Log in or sign up for Devpost to join the conversation.