Inspiration
Inspired by Duolingo application, and we would like to make this app go beyond by leveraging AI intellect and voice in student learning experience
What it does
A step-by-step learning app start with languages learning and math, allows AI to rate player's submission and performance and make recommendations.
How we built it
We use Kiro IDE to build the applications, leveraging powerful specs, steering and MCP support. Technologies involved: vercel AI-SDK for web app foundational structure, supabase for auth and database, Gemini model for LLM model, ElevenLabs for voice models, and of course Kiro for IDE and AI-assisted coding.
Challenges we ran into
First we use Google voice API to play AI tutor and it sounds horrible, then we switch to eleven labs for playing voice, and use Gemini model for reviewing user's voice input. that combo works really well.
Accomplishments that we're proud of
A quick learning experience with Kiro and everything is easy to understand and quickly turn into production-level codebase, We use supabase MCP in Kiro for quick DB debug and it works so well and saved so much effort for manual debugging. Kiro can also generate required Supabase table query and creation SQL, RLS policy SQL script that we can implement in MCP directly. We are specially proud of using AI as the tutor to play the tutorial and review user's input
What we learned
In AI assisted coding age, it is important to create the specs, steering, hooks and think of AI (kiro) as your co-developer to help you create structure, review code, debug, select the right MCP tools are also essential to development. Human developer needs to moderate the overall structure, and describe the issue and task with clear details so Kiro can best support.
What's next for Aibubu Learning
We would love to support Claude Skill feature in our app, so individual skills (for example pronunciation and techniques for words in different context) are packaged as Skills to upload to LLM agent chat context, this way, AI tutor can be smarter and have interactive chat context with the user in voice. The good news is vercel AI sdk 5 latest version provides new support skills for Claude models, this requires skill upload to user's Anthropic account and have a pro subscription, so this is what we plan to support for user who has a Claude pro subscription and would like to use specific skill packages.
Built With
- ai-sdk
- claude
- elevenlabs
- gemini
- supabase
- typescript
- vercel
Log in or sign up for Devpost to join the conversation.