🎬 What it does?

Act One is an immersive rehearsal tool where actors can practice solo or in pairs inside virtual sets filled with realistic props. The AI generates random scene scenario that actors roleplay in, encouraging spontaneous, in-character performances. As they act, their audio is recorded and analyzed, and after the scene, an AI director provides personalized feedback on tone, pacing, and emotion. It’s a cinematic, on-demand rehearsal space that helps actors refine their craft and gain intelligent feedback based on the director's vision.

1. What inspired you to build this project?

Given that we are building in the entertainment capital, we were inspired by the challenges actors and directors face when rehearsing — limited access to sets, props, and direct feedback. Traditional rehearsals can be expensive, inflexible, and constrained by location or crew availability. We wanted to reimagine that process through AR, making rehearsal something that could happen anywhere.

Act One was inspired by the idea that every performer should be able to step into their story — to rehearse inside their scene, surrounded by virtual props scanned from the real world, and guided by intelligent, responsive feedback that feels like having a digital director at your side.

How we built it

We built Act One using Supabase, which allowed us to leverage advanced GPT-5 calls to generate dynamic scene scenarios and analyze performances through text and speech. ElevenLabs adds a cinematic touch by voicing the AI director, creating the sense of real-time feedback and guidance. Supabase Edge Functions handle processing and data flow between the AR environment, AI services, and user sessions, enabling smooth, responsive interaction.

The interface features a Hollywood-inspired aesthetic, with interactive virtual props that both players can use during scenes. Each environment is designed to reflect the emotional tone or genre of the scenario, creating an intuitive, polished experience that performs seamlessly and captures the energy of a live rehearsal.

What we learned

We’re proud of having audio files processed within capacity limits and successfully uploaded to our Supabase database. We built a Connected Lens experience, overcoming multiple bugs and technical challenges to make it work smoothly across users.

We’re especially proud of creating an animated, Hollywood-inspired UI and conceptualizing the idea to truly bring this experience to Hollywood actors and directors — transforming how they rehearse, collaborate, and receive feedback in a cinematic, immersive way

What's next for Act One

Next, we’re expanding Act One to give creators and performers even more control and flexibility. Directors will be able to upload their own scenes and props, while actors can choose to rehearse with a personal script or an AI-generated scenario. We’re also introducing progress tracking over time to help users measure growth in their performances.

Future updates will include support for more than two actors, enabling full-cast rehearsals, and an AI scene-reader feature that lets solo actors perform alongside an intelligent virtual partner. Together, these additions will make Act One a complete virtual rehearsal studio for every stage of the creative process.

Built With

Share this project:

Updates

Submission history