-
-
Voce commands, characters respond to
-
Eleven Labs integration for character audio
-
Fun actions the Characters respond to
-
Animated Effects gallery
-
Animated backgrounds, globe moving, etc
-
Write your own play and run it!
Inspiration
My little 5 year old nephew is diagnosed with ADHD, and does not speak. I wanted to find a way to inspire him. By incorporating voice recognition and text to speech (from Eleven Labs), in a fun environment would get him to start speaking and interacting, communicate his mind and expressions.
What it does
I have used ClippyJS to bring out the classic interactive MS characters Merlin and Genie. Through voice recognition or clicking on commands the Characters respond in a fun way, via their actions or audio (via Eleven Labs). I have also emersed the experience by incorporating fun effects (snow, rain, etc), plus video backgrounds (space & forests). The advanced feature is where he can create his own scripted story and play back the commands - a fun way to learn programming.
How we built it
Bolt! with lots of love. Lots of integartion elements such as ClippyJS, Eleven Labs, YouTube Integration, voice recognition, animated effects (snows, etc) etc.
Challenges we ran into
My welcome pack got lost in the mail, so used free daily credits (and eventually bought credits) to model together a great app. I also registered with Bolt partners (Supabase & Eleven labs). Had a conflict with Supabase on my project due to some existing triggers, so parked that integration sadly.
Accomplishments that we're proud of
The speed of using Bolt and the ease of integration with Eleven Labs for the audio and ClippyJS (was impressed!). Loved the overall creative process. I first had this idea 25 years ago and was always on the back burner, so happy to finally see this project take shape!
What we learned
Clicking on the icon for the app, I have all my lessons learn per day, enhancements, bug fixes and amazing fetaures.
What's next for Magic Codebook
Supabase Integration! Login, users can upload their own videos, pics and save their scripts. Get product to the world and into schools! I volunteer teach at a Cambridge affiliated school, so looking forward to getting the kids to play with the app and also the older kids to work with Bolt itself and inspire their creativity.
Log in or sign up for Devpost to join the conversation.