Inspiration
What if there was a way to talk with a family member who is unreachable in another continent, has passed away, who is "unreachable." We developed Unreachable to see the extent to which AI could help those feel a sense of comfort in finding what they've lost.
What it does
Unreachable learns the writing style, memory, and voice pattern of the one that user wants to talk to. It can be their child who is too busy with work, it can someone passed away but they missed so much... Eventually, Unreachable trains an AI chatbot thats talks like the one you want to talk to.
How we built it
We fine tuned gpt-3.5-turbo to speak like one of us and integrated it with Discord.js and Eleven Labs. Our product can be tested at https://discord.gg/B7RNyjDA.
Challenges we ran into
Integrating our cloned voice with Eleven Labs, and integrating it into Discord.js was a challenge due to the inconsistencies in API call times (Open AI, Eleven Labs and Discord.js).
Additionally, we ran into issues when fine tuning our model to speak like us. Specifically, if we provided cases that spanned too broad of a scope. e.g. fine tuning to questions ranging from "How was school?" to "What's your favorite sport," we found the model would find excessive liberties in its responses.
What's next for Unreachable
Currently the MVP of Unreachable simply allows users to talk to Jeffrey (one of our developers), but in the future they will be able to talk to anyone (as long as you have their text/audio files/also their consent if possible). Additionally, implementing security measures to ensure that users feel comfortable talking to the bots will be crucial for Unreachable's adoption.
Built With
- discord.js
- eleven-labs
- openai
Log in or sign up for Devpost to join the conversation.