Inspiration
I was inspired by the desire to preserve and celebrate natural skills like handwriting and drawing while blending them with modern digital experiences. I wanted to make sure that the joy of writing or sketching by hand wouldn’t be lost in an increasingly tech-driven world. This project aims to encourage fine motor skills and creativity while introducing children to the possibilities of AI and interactive learning.
What it does
The Interactive Library offers a magical AI-powered ebook experience where kids can browse and explore books with the help of a friendly conversational video assistant. Meanwhile, the AI Drawing Book lets children turn their handwritten or digital drawings into beautiful, AI-generated illustrations they can color and connect to stories — making reading and creativity come alive in one seamless platform.
How we built it
We built the frontend using React (TypeScript), styled with Tailwind CSS and PostCSS for a modern, friendly look. We integrated Tavus and ElevenLabs to power the conversational video assistant, enabling real-time voice interaction. For drawing recognition and story generation, we used Gemini and Pollination AI, allowing children’s handwritten or digital drawings to be turned into unique images. Authentication and storage were handled using Supabase to keep everything secure and scalable.
Challenges we ran into
Combining natural input (like handwriting and drawing) with digital AI features in a way that feels intuitive and smooth was a major challenge. We also had to carefully manage latency and synchronization for the real-time video assistant to make conversations feel natural. Integrating multiple AI services and maintaining a consistent user experience across different features pushed us to refine our design and technical approaches continuously.
Accomplishments that we're proud of
We’re proud of successfully merging traditional, hands-on creative activities with advanced digital tools in a way that feels seamless and inspiring for kids. Seeing children interact naturally with their drawings and then light up when they see their art come alive through AI has been incredibly rewarding.
What we learned
We learned how to create a cohesive and engaging experience that bridges the gap between natural motor skills and digital interactivity. We also gained deeper technical skills in AI integrations, real-time video and voice interfaces, and user-centered design for young audiences.
What's next for Interactive Library
Next, we plan to expand the book catalog and add more personalized learning paths guided by the AI assistant. We also want to introduce more advanced drawing challenges, collaborative story features, and classroom tools so educators can use it in group settings. Additionally, we aim to onboard book publishers for paid integrations, giving kids access to a wider range of premium content while supporting authors and publishers. We also plan to partner with museums, turning historical and cultural collections into interactive learning experiences. We’ll add payment options to enable subscriptions or premium content purchases, and we’re working on optimized versions for smaller screens so the experience is smooth and engaging on all devices, including tablets and smartphones.
Ultimately, we want to make the platform even more interactive, inclusive, and inspiring for children and educators around the world.
Built With
- elevenlabs-conversational-ai
- gemini-ai
- lucide-react
- pollinations-ai
- postcss
- react-(typescript)
- supabase-(auth-&-storage)
- tailwind-css
- vite
Log in or sign up for Devpost to join the conversation.