Inspiration
One of the earliest linguistic artifacts, the Rosetta Stone contained inscriptions of Greek, Egyptian, and Hieroglyphic text and took nearly 20 years for scholars to decipher. Since the inception of modern computing, companions have had an essential role in the advancement of our understanding. It is these inspirations that birthed the Rosie Language Companion.
What it does
The Rosie Language Companion helps people learn new languages with a user-defined curriculum, a variety of learning approaches, and SMS compatibility.
How we built it
The Rosie Language Companion was built with the a16z companion app, Eleven Labs LLM, ChatGPT and Whisper from OpenAI, and D-ID AI. After forking the a16z companion app, we created our own markdown file that gave our companion its own personality. With ChatGPT and Whisper, we were able to convert text to speech and vice versa, so the learner and Rosie could converse. Rosie's voice was synthesized by Eleven Labs. D-ID AI was used to create Rosie's avatar.
Challenges we ran into
Our greatest challenge was getting our avatar to output the speech audio.
Accomplishments that we're proud of
We're proud of getting our MVP live and using Rosie to learn Spanish.
What we learned
While building the Rosie Language Companion, we learned how to foster language learning with the help of interactive AI technology.
What's next for Rosie Langauge Companion
The next focus for the Rosie Langauge Companion is to add other widely-spoken languages and advance the knowledge of learners all across the globe.
Built With
- chatgpt
- d-id
- elevenlabs
- javascript
- next.js
- whisper
Log in or sign up for Devpost to join the conversation.