About the Project
The Inspiration Behind Nora AI
Before becoming an engineer, I was an early childhood teacher. In my class, I had two siblings with speech delays. Their mother—a single parent working tirelessly to make ends meet—had little time to engage them in meaningful conversations. The cause of their speech delay wasn’t biological; it was simply a lack of exposure to language.
This experience stayed with me. As I transitioned into engineering, I realized that AI has the potential to bridge this gap by providing interactive, language-rich conversations to children who might not otherwise have access to them. That’s why we built Nora AI—a multilingual, interactive AI companion designed to help children develop confidence in communication, no matter their circumstances.
What We Learned
Building Nora AI was more than just applying AI models—it was about understanding how children learn, how AI can support that process, and how to ensure safe, meaningful interactions.
We explored:
- Speech-to-Text (STT) and Text-to-Speech (TTS) using ElevenLabs to make interactions engaging and natural.
- Multi-AI Agent Collaboration to enable Nora AI, supporting characters, and interactive elements to work together seamlessly in conversations.
- Parent Feedback Mechanism, providing structured insights on the child’s speech patterns, vocabulary use, and engagement, aligned with the Early Years Learning Framework (EYLF).
- ElevenLabs Conversational AI for real-time speech synthesis and natural-sounding dialogue.
Beyond the technical aspects, we learned the importance of responsible AI—creating a system that is emotionally intelligent, safe, and engaging for young learners.
How We Built Nora AI
Nora AI was designed with AI-driven personalization and real-time interaction at its core.
Tech Stack & Core Features:
Conversational AI (ElevenLabs Conversational AI)
- Real-time, interactive conversation through embedded ElevenLabs AI widget.
- Child-friendly voice output for an engaging and accessible experience.
- Real-time, interactive conversation through embedded ElevenLabs AI widget.
Speech & Transcript Processing
- Speech-to-Text (STT) for real-time transcription.
- Fetches complete conversation transcripts for language analysis.
- Speech-to-Text (STT) for real-time transcription.
Multi-AI Agent Collaboration
- Enables Nora AI and supporting characters (e.g., space-themed guides, farm animals, underwater creatures) to engage dynamically.
- Enables Nora AI and supporting characters (e.g., space-themed guides, farm animals, underwater creatures) to engage dynamically.
Automated Transcript Retrieval
- Fetch the child’s conversation transcript with a single click.
- Includes both Nora’s responses and the child’s dialogues (labeled “Little Explorer”).
- Fetch the child’s conversation transcript with a single click.
Language Development Analysis & Parent Feedback (Google Gemini AI & Automated Transcript Retrieval)
- The transcript is processed by Google Gemini to analyze:
- Child’s speech patterns and language usage.
- Main topics and engagement levels.
- Positive developmental highlights and areas for improvement.
- Suggested conversation starters and hands-on activities.
- The transcript is processed by Google Gemini to analyze:
User Interface & Parent Insights
- Built with Streamlit (Python) for an intuitive, lightweight web interface.
- Space, Sea, Jungle, Farm Exploration Themes for an engaging UI.
- Parent dashboard generates structured reports aligned with EYLF, helping parents support learning at home.
- Built with Streamlit (Python) for an intuitive, lightweight web interface.
Challenges We Faced
Every AI project comes with obstacles, and Nora AI was no exception.
1️⃣ Handling Multi-Turn Conversations with Multiple AI Agents
Ensuring that multiple AI characters respond naturally, follow context, and stay engaging was a challenge. We designed an agent coordination system to structure interactive storytelling and guided play.
2️⃣ Balancing Engagement with Safety
The AI needed to be playful yet responsible. We implemented:
- Conversational guardrails to gently redirect inappropriate language.
- Emotionally intelligent responses to support children through expressive, empathetic interactions.
3️⃣ Providing Parent-Friendly Insights Without Overwhelming Data
We simplified our approach to parent reports, ensuring:
- Concise conversation summaries.
- Language milestone tracking.
- Actionable suggestions to extend learning at home.
Final Thoughts
Nora AI is more than just a tool—it’s a bridge between AI, education, and real-world impact.
For children, it’s a friendly companion that makes communication fun.
For parents, it’s a support system that provides insights and guidance.
For educators, it’s a scalable way to reinforce language development.
Through AI, we’re not just helping children learn language—we’re giving them a voice.
Log in or sign up for Devpost to join the conversation.