✨ Twinkle — Interactive Learning

Slogan

“Where Learning Comes Alive”


Inspiration

The inspiration for Twinkle began with a simple but often overlooked reality:
children do not all learn in the same way—especially children with ADHD.

We observed that many children struggle not because they lack curiosity or ability, but because traditional learning environments expect attention to be static. Sitting still, reading long passages, and repeating information can feel unnatural and exhausting. Yet the same children can remain deeply focused for long periods when learning is tied to movement, sound, imagination, and immediate feedback.

We also noticed a gap between parents’ intentions and children’s experiences. Parents want to guide what their children learn and ensure real progress, while children want learning to feel playful, magical, and self-driven. Too often, educational tools prioritize one side at the expense of the other.

Twinkle was born from the desire to connect these two worlds.

We drew inspiration from storybooks as portals—objects that transport readers into new worlds—and from concepts like memory palaces and experiential learning, where knowledge is reinforced through space, action, and emotion. Instead of presenting words on a flat screen, we imagined learning as a world children could enter: an island that emerges from a magical book, where learning is woven naturally into play.

In Twinkle, learning is not something children pause their fun to do—it is the fun. Movement, curiosity, repetition, and multisensory interaction become tools for understanding. When a child struggles, the system doesn’t punish or rush them; it adapts, slows down, and gently reinforces learning through sound, speech, and touch.

At its heart, Twinkle is inspired by one belief:
learning should feel magical, not mechanical—and every child deserves a learning experience that moves with them, not against them.


What it does

Twinkle is a multisensory, game-based learning platform designed to adapt to both parental guidance and children’s natural learning rhythms.

  • Parent-Guided Learning Intent
    Parents begin by entering a natural-language prompt describing what they want their child to learn (such as action words, daily objects, or basic vocabulary). An AI backend interprets this intent and generates a structured learning plan.

  • Cinematic Book-to-Island Experience
    Children enter the learning world by opening a magical book, which transitions into a low-poly island environment—creating a strong narrative bridge between curiosity and exploration.

  • Interactive Island Gameplay
    Within the island, children navigate a continuous adventure-style environment. Actions like jumping, turning, and avoiding obstacles are directly linked to learning prompts.

  • Multisensory Reinforcement
    If a child encounters difficulty, the game gently pauses and guides them through listening, tracing, and speaking activities before allowing them to continue—reinforcing understanding without pressure.

  • Parent-Friendly Learning Summary
    Parents can view a clear and simple summary of learning progress, engagement, and areas needing reinforcement, without overwhelming technical detail.


How we built it

Twinkle was built using a modular, modern web stack focused on flexibility, performance, and scalability:

  • Next.js & React
    For application structure, routing, and state management.

  • Three.js / React Three Fiber
    To render 3D scenes including the book-opening sequence, island environments, and interactive gameplay elements.

  • Blender
    Used to design and arrange low-poly island assets and environments, exported as .glb files optimized for web performance.

  • Anthropic Claude API
    Powers the AI layer that transforms parent prompts into structured learning content, validated through strict schemas to ensure safety and consistency.

  • Modular Learning Engine
    Separate services handle audio (text-to-speech), visuals, tracing paths, speech recognition, and interaction logic—allowing each module to evolve independently.

This architecture ensures that AI decides what to learn, while the game engine determines how learning is experienced.


Challenges we ran into

  • Balancing engagement and focus
    Creating a game that is exciting without being overstimulating required careful pacing, restrained animations, and thoughtful feedback design.

  • Ensuring reliable AI output
    Natural language input can be unpredictable, so we implemented strict schemas and validation layers to keep learning content safe and consistent.

  • Web-based 3D performance
    Optimizing assets, animations, and interactions to maintain smooth performance across browsers was an ongoing challenge.

  • Designing for two audiences
    Parents seek clarity and measurable progress, while children seek magic and play. Bridging these perspectives required intentional UX decisions.


Accomplishments that we're proud of

  • Creating a learning experience that feels like an adventure, not an assignment
  • Successfully integrating AI-driven personalization with real-time gameplay
  • Designing a memorable book-to-island transition that anchors the experience emotionally
  • Building a modular system capable of expanding beyond vocabulary learning
  • Keeping the experience ADHD-friendly, with short feedback loops and adaptive pacing

What we learned

  • Learning is most effective when it is embodied, playful, and responsive
  • AI is most valuable as a guide and planner, not a replacement for thoughtful design
  • Modular architecture is essential when combining AI, 3D graphics, and education
  • Small UX details—motion timing, visual softness, audio cues—have a large impact on focus
  • Parents value clear summaries, not complex analytics

What's next for Twinkle

  • Expanding learning beyond individual words into sentences and comprehension
  • Introducing multiple island worlds, each themed around different learning domains
  • Improving adaptive difficulty using long-term learning patterns
  • Exploring co-learning features for parents and children
  • Adding accessibility and multilingual learning support

Twinkle represents our vision of learning as something children experience—a world they explore, discover, and grow within, one island at a time. 🌈

Share this project:

Updates

Submission history