Inspiration
As a kid, I spent hours glued to the screen, watching cartoons—but what if I could have been learning and moving at the same time? That question sparked the idea for this exergame. In today’s digital world, kids are more passive than ever, so I wanted to create something that makes screen time active and engaging. This game transforms cartoons into an interactive adventure, where kids don’t just watch—they jump, squat, reach, and move to play and learn. By blending fun physical challenges with storytelling, this game turns exercise into excitement and learning into a full-body experience!
What it does
Interactive Cartoons: Transforms cartoons into interactive learning experiences. Active Participation: Encourages physical activity through fun movements like jumping, squatting, and reaching. Movement-Based Learning: Kids answer questions and solves puzzles by performing different physical challenges. Progress Tracking: Tracks progress, rewarding both physical activity and knowledge. Parental Control: Parents can check their kids performance, data analysis with graph and feedback from "Gemini". ChatBot: Has a Gemini powered chatbot that can be help the parents with parenting by answering to their queries 24x7.
How we built it
tools & libraries: backend: Java, Spring Framework, Gemini Api, Intellij IDEA, MySQL frontend: React.js, Node.js, Typescript Machine Learning: Mediapipe, Numpy, Flask
So we created the website (front end) which was connected with our backend (servers). We had to created two server: 1) One with spring framework and Java: to handle authorization, handling external APIs, working Gemini Api. 2) One server using flask & python: This was to store our pose detection code. We sent the video captured from the website using webcam, frame-by-frame to the ML server and got the gesture as a json respone.
Challenges we ran into
1. One of us created a server using the Spring framework, hosted on his laptop, while the other hosted the website on their laptop. We found it really difficult to integrate the two because the server was not accessible from the outside, making it hard to connect the website and server.
Accomplishments that we're proud of
We finished the project according to our plan even though we had to sacrifice our sleep.
What we learned
1. We worked together with three different languages and so many different tools. We learned to integrate them together which is the most proud achievement of ours. 2. This is our first time building a game as we all are web developers.
What's next for Toon Fit
1. In the near future, we will add games that are mentally and intellectually challenging not just physically challenging. 2. We will add online multiplayer option to make the game more engaging. 3. We want to integrate powerful AI model. The parents will be able to choose video topic and our model will generate question set from that.
Built With
- flask
- java
- javascript
- native
- numpy
- opencv
- pose-detection
- python
- react
- react-native
- springboot
- typescript
Log in or sign up for Devpost to join the conversation.