Inspiration Our project was inspired by the growing need to make early childhood education more engaging and interactive. We observed that young children learn best when they can move and interact physically with their environment. By combining cutting-edge technology with educational principles, we aimed to create a solution that would make learning both fun and effective for kindergarten students.
What it does CycleUp is a comprehensive educational platform that uses computer vision and AI to create an interactive learning environment. The system uses MediaPipe for real-time pose detection and gesture recognition, allowing children to interact with educational content through their movements. Our AI-powered kindergarten assistant provides real-time feedback and guidance, using text-to-speech technology to communicate with students in a friendly, engaging manner. The platform supports various educational activities, from basic movement exercises to interactive learning games.
How we built it We developed CycleUp using a modern tech stack: Frontend: React.js with WebGL for smooth camera integration Backend: Flask server with Python AI Integration: Google's Gemini API for intelligent responses Computer Vision: MediaPipe for pose detection and gesture recognition Real-time Communication: LiveKit for video streaming Database: Supabase for data management Voice Interface: Text-to-speech capabilities for natural interaction
Challenges we ran into During development, we faced several significant challenges: Integrating real-time pose detection while maintaining smooth performance Synchronizing the AI assistant's responses with physical movements Implementing reliable speech recognition and synthesis Managing state between different components while keeping the camera active Deploying the application with proper environment configurations Accomplishments that we're proud of Successfully created a seamless integration between physical movement and digital learning Implemented responsive and accurate pose detection Developed an intuitive and child-friendly user interface Created a scalable architecture that can support multiple educational activities Achieved natural communication between the AI assistant and users
What we learned Through this project, we gained valuable experience in: Real-time computer vision integration AI model implementation and optimization Full-stack application development User experience design for young children Deployment and scaling of complex web applications
What's next for CycleUp Future development plans include: Expanding the educational content library Adding multiplayer capabilities for classroom settings Implementing more sophisticated gesture recognition Creating a teacher dashboard for progress monitoring Developing custom educational games and activities Improving accessibility features for diverse learning needs
Log in or sign up for Devpost to join the conversation.