Backstory After relocating to another country, I struggled to stay connected with my best friend due to the significant time difference and our busy schedules. To combat the feeling of isolation and maintain a sense of connection, I embarked on creating an AI version of my friend. This complex endeavor led me to start by replicating well-known personalities to better understand the technology. The journey began with exploring data sources like YouTube and evolving into a sophisticated system capable of creating realistic AI clones.
Data Processing: Using Python scripts to collect and format data for the LLM. Voice Replication: Employing ElevenLabs to mimic the voices of individuals. Interaction Integration: Utilizing Twilio to enable users to make phone calls to these AI clones.
Technical Details One of the primary challenges was developing a script capable of formatting raw data into a structure comprehensible to the LLM. Various approaches were tested, including running LLMs locally with LLaMA and fine-tuning models, but these often lacked the desired accuracy. Through persistent experimentation, we devised a unique method that significantly improved the results. Our technical stack includes:
Next update will bring a possibility to clone famous person from just pasting YouTube videos and/or articles about him or her
Try it out: +1 520 549 6237
Log in or sign up for Devpost to join the conversation.