PerfectCast

Inspiration

The inspiration behind PerfectCast came from the challenges content creators and aspiring actors face in the casting process. Traditional methods are often time-consuming, expensive, and limited by geography. We wanted to leverage Eleven Labs' powerful technology to create a seamless, autonomous platform that connects talent with opportunities, making the process more efficient and accessible for everyone.

Our motivation was to enable people from across the globe to find opportunities, not only aspiring actors but also students, stay-at-home parents with tight schedules, and individuals trying to set their foot into the industry. We believe everyone deserves a chance to showcase their talent, regardless of their location or circumstances.

Ultimately our vision was to let people focus on creation instead of formalities burden. We truly believe that

What it does

PerfectCast is an app that automates the process of finding actors for content creators and movie directors. Aspiring actors can apply from anywhere by simply talking to the camera about themselves. Our AI assistant evaluates their profiles and matches them with suitable offers from content creators. Content creators, on the other hand, gain access to a pool of talented individuals tailored to their production needs. The platform also allows recruitment agencies to adopt the solution to streamline their operations.

How we built it

We built PerfectCastusing Eleven Labs' cutting-edge AI technology for voice and video analysis. The app integrates natural language processing (NLP) to understand and evaluate actor profiles, and machine learning algorithms to match them with the right opportunities. We also incorporated image recognition to analyze facial expressions and used Eleven Labs' emotion extraction capabilities to evaluate the emotional tone of the audio. The front-end was designed for ease of use, allowing users to record and upload videos effortlessly. The back-end handles data processing, matching, and communication between users.

Challenges we ran into

The biggest challenge was crafting effective prompts for the ElevenLabs Conversational AI voice agent. Despite explicitly instructing the agent to avoid certain behaviors, it would sometimes still exhibit them. Integrating All Components - bringing together various parts of the system—voice analysis, video processing, and AI interaction—was complex and required careful coordination. Emotion and Speech Analysis - analyzing voice and video for emotions, diction, and other attributes was challenging. We had to rely on a new service (imentiv.ai) for us, that we didn't know before. So we were unsure about their accuracy and reliability and had to learn on the go. Speech-to-Text Limitations - ElevenLabs' speech-to-text feature is in alpha access. (But available through conversation) Matching the Agent’s Voice to the Screenplay - Adjusting the AI-generated voice to match the screenplay remains a manual process. Currently, we lack an automatic method to seamlessly adapt the voice to the context and setting of each scene.

Accomplishments we are proud of

Seamless User Interaction – Ensured a smooth and engaging user experience within the app. Human-Like AI Conversations – Developed a conversational agent that effectively simulates role-playing interactions. Optimized AI Prompts – Through trial and error, we crafted prompts that significantly improved the agent’s performance. Successfully aligned the AI-generated voice with the character’s role. Efficient Code Integration – Connected multiple diverse components in a short timeframe. Smart Use of AI Tools – Effectively utilized various AI development tools, including Lovable, Cursor, Supabase, and Render. Integrated several technologies we had never used before. Successfully divided tasks among a team with diverse skill sets and backgrounds. Innovative Brainstorming Sessions – Engaged in extensive discussions to refine and develop the project idea efficiently. Combined LLM-based prompts with machine learning algorithms to enhance talent-role matching. Identified multiple market challenges that our app could potentially address. Dynamically adjusted the project scope to focus on core functionality based on feedback from hackathon mentors. :) Created an exciting and compelling video to present our project.

What we learned

Prompting, prompting, prompting… - ElevenLabs Conv AI, OpenAI text generation, Working with Lovable Efficient collaboration under time constraints while maintaining a positive and focused work environment.

What's next for PerfectCast

Next, we plan to expand the platform's capabilities to make it a universal hub for connecting people. On one hand, there are creators—content creators, filmmakers, and innovators—who want to bring their ideas to life. On the other hand, there are individuals—actors, students, stay-at-home parents, and enthusiasts—who want to take part in exciting activities and projects. Our goal is to bridge this gap seamlessly, enabling collaboration on a global scale.

A key focus will be revolutionizing the legal and administrative aspects of project participation. We aim to replace the traditional complexities of signing workers by automating the entire process. This includes removing the burden of contracts for content creators and ensuring secure, timely payroll for talent. By streamlining these processes, we want to empower creators to focus on their craft while providing talent with the assurance of fair compensation and transparency.

Ultimately, we envision PerfectCast as the go-to platform for talent discovery, collaboration, and project execution, transforming how people connect and create together.