Avasteller

Avasteller is the tool for educators and storytellers alike, helping them create engaging discussions and conversations between generated avatars of real or fictional characters to convey any topic.

Comment

Inspiration

Our project was inspired by the Heads in Jar concept from Futurama, where we aimed to bring historical figures back to life in a captivating way. The core idea is to generate videos of debates between two or more historical figures, enhancing educational experiences.

What It Does

Avasteller generates videos featuring conversations between characters based on user-provided descriptions. Users can oversee both the scriptwriting process and the avatar design for each character, creating a personalized educational tool.

How We Built It

Our front end starts by prompting users for the names and descriptions of their characters, along with an overview of the intended conversation. From these inputs, we:

  • Utilize AI/ML APIs to generate profile photos that serve as avatars for the characters.
  • Leverage Mistral’s large language models to craft the script for the character interactions.
  • Employ HeyGen to transform the script into a series of videos, stitching together clips for each message to produce the final product.

Challenges We Encountered

We faced challenges in parsing sufficient documentation from sponsored tools, limiting our ability to fully utilize all the relevant resources for our project.

Accomplishments We’re Proud Of

We successfully completed the initial build of Avasteller, demonstrating its core functionalities and potential impact on education.

What We Learned

Throughout this process, our team gained valuable experience with various tools, including HeyGen and AI/ML APIs. We also explored additional tools like Vectara and Exa, which we didn’t have time to implement but hold promise for future enhancements.

What's Next for Avasteller

To further enhance Avasteller, we plan to integrate:

  • Exa for more informative backgrounds that enrich character conversations.
  • ReTell AI to deliver higher fidelity audio clips for each character.
  • AutoGen to allow users to participate in conversations, interacting with characters as agents in a group chat.

By implementing these features, Avasteller aims to address three popular use cases:

  1. Script and Screenplay Generation: A valuable tool for screenwriters and playwrights.
  2. Content Conversion: Transforming scripts into engaging audio or video formats, enhancing entertainment value and simulating read-throughs.
  3. Video Content Creation from Audio: For instance, turning podcasts into video form to create additional revenue streams from existing content.

Built With

Share this project:

Updates