Inspiration
We were inspired by nostalgic games like Cooking Mama and Overcooked!, and we wanted to make an immersive experience in arcade-styled games by incorporating sensors, as if you were actually chopping or mixing.
What it does
Players have a knife or a spoon that have sensors that can detect and identify motion such as chopping or mixing, and plates have ArUco tags that allow our program to detect where plates are in the coordinate system map (e.g. has it been served, is it in the processing zone for chopping/mixing, etc.)
How we built it
We used EdgeImpulse to train our machine-learning model on movements and ArUco tags that help make a coordinate-system map.
Challenges we ran into
Some challenges we faced were training our machine learning model on how to detect and identify certain movements, like chopping and mixing and when the tool is idle.
Accomplishments that we're proud of
We're really proud of our model's ability to correctly identify chopping and mixing motions, as well as when the tool/player is idle. We're also really proud of the coordinate-system map we made with the ArUco tags.
What we learned
We learned a lot about how much planning and organization has to go into game design and how integrated it is into the actual coding aspect.
What's next for Chef's Kiss
It would be really fun if we could make it into a real/official game for people to play!
Built With
- ai
- art
- edgeimpulse
- esp32
- imu
- machine-learning
- opencv
- pygame
- sensors
Log in or sign up for Devpost to join the conversation.