INSPIRATION
What if watching a movie became an invitation to participate? What if you could step into a story, choose your role, and invite family and friends to join your cinematic experience?
This question inspired ACTORSELF: an interactive entertainment concept envisioned for the Amazon Prime Video ecosystem.
For this hackathon, we developed a web prototype with a simulated Alexa+ conversational experience that helps users navigate and personalize their journey.
Our vision is simple: Don’t just watch the story. Be part of it.
WHAT ACTORSELF DOES TODAY
The current prototype combines a cinematic interface, demonstration scenes, a photo and consent workflow, customization options, and browser-based audiovisual composition.
Its Alexa+ web simulator lets users enter commands in English or Spanish to control the application. For example:
• “Alexa, open ACTORSELF” opens the story selection screen. • “Choose Kepler” selects a story and its protagonist role. • “Choose mystery ending” updates the ending preference while preserving the selected story. • “My role” or “Status” reports the current selection. • “Prepare my scene” guides the participant to the photo and consent workflow. • “Open scene catalog” opens the demonstration video catalog.
These commands change the application’s actual state. The simulator maintains context across supported interactions, connecting story selection, character choice, customization, and scene preparation.
Consent remains a personal decision: the assistant cannot grant it on the participant’s behalf. If consent has not been confirmed, the simulator directs the user to review the form before proceeding.
The conversational interface currently uses typed commands and deterministic intent matching. It is a web simulation, not a live Alexa+ integration or a deployed Alexa Skill.
THE LONG-TERM VISION
ACTORSELF proposes five connected capabilities:
Become the protagonist
Select an eligible, licensed title and personalize a character’s appearance using an authorized facial profile.Invite family and friends
Invite other eligible Prime members to participate through individual accounts, with explicit consent from every participant.Explore alternative scenes
Create personalized dialogue, alternative endings, and new narrative moments within the permissions granted by content owners.Navigate conversationally
Use Alexa+ to discover stories, choose roles, adjust preferences, and control playback across compatible devices.Share authorized previews
Share short, approved clips while keeping full personalized experiences within the appropriate access and licensing boundaries.
These capabilities describe our proposed direction. The prototype does not currently authenticate Prime memberships, access the Prime Video catalog, provide photorealistic face replacement, or implement multiuser casting.
WHY ALEXA+ MATTERS
Personalizing a cinematic experience involves several decisions. A conversational assistant could make that process easier by remembering choices and guiding users through the next step.
Instead of navigating every screen manually, a participant could ask:
“Alexa, open ACTORSELF. Choose Kepler, make me the commander, and use a mystery ending.”
Our prototype demonstrates parts of this journey through supported commands and contextual responses. It also explores an important boundary: an assistant can guide a participant to consent, but should never provide consent for them.
Future development would extend this foundation to natural-language understanding, voice input, playback control, and permission-aware invitations through supported Alexa+ interfaces.
A POTENTIAL OPPORTUNITY FOR PRIME VIDEO
ACTORSELF envisions personalized entertainment as a way to strengthen engagement and shared discovery.
In the proposed model, full personalized experiences would require eligible Prime memberships and valid viewing rights. Each participant would use an individual account and provide consent.
Short, authorized previews could introduce others to the experience, while complete versions would remain within the licensed ecosystem.
This could support content discovery, repeat viewing, and subscriber engagement. These are hypotheses to validate, rather than outcomes demonstrated by the prototype.
HOW WE BUILT THE PROTOTYPE
The application uses React, TypeScript, and Vite for the web experience.
The simulated Alexa+ interface connects directly to application state, allowing supported commands to select stories, display roles, change ending preferences, and open the consent and preparation screens.
The existing audiovisual prototype uses browser technologies, including Canvas, Web Audio, and MediaRecorder, to compose short demonstration scenes locally.
The prototype runs in a compatible desktop browser without requiring an AWS connection for its core local demonstration.
Alexa+, Fire TV, Prime Video, and AWS integrations remain proposed future development. We have not deployed an Alexa Skill or MCP server, connected to Prime Video, or completed AWS OIDC authentication.
CHALLENGES AND WHAT WE LEARNED
A major challenge was separating the full product vision from what we could demonstrate reliably.
Realistic facial integration requires preserving lighting, expressions, movement, and cinematography. Our browser-based composition is an exploratory prototype, not a completed photorealistic face replacement system.
We also encountered practical onboarding barriers. The supported Vega simulator environment was incompatible with our Windows setup, and our AWS account gated identity providers behind advanced account features. We chose the Alexa+ web simulation route and kept the demonstration independent of those services.
These experiences reinforced the importance of clear setup requirements, accessible development paths, and honest descriptions of prototype capabilities.
Privacy, individual consent, biometric protection, and content licensing remain central design requirements. Any direct Prime Video integration would require Amazon’s cooperation and appropriate authorization from rights holders.
WHAT’S NEXT
Our next steps are to expand conversational understanding, add voice interaction, improve scene composition, and test the experience with users.
We also want to investigate supported Alexa+ integration options and validate the licensing, security, and account requirements for collaborative personalization.
OUR VISION
ACTORSELF imagines entertainment where viewers can participate creatively, families can become casts, and stories can feel personal.
The current prototype takes an initial step toward that vision through a cinematic web experience and a contextual Alexa+ simulation.
ACTORSELF — Your Movie. Your Role. Your Story.
Live prototype: https://marketingandcoach-cyber.github.io/actorself-ai-studio/
Built With
- alexa-skills-kit
- amazon-api-gateway
- amazon-bedrock
- amazon-cloudfront
- amazon-cognito
- amazon-dynamodb
- amazon-fire-tv
- amazon-web-services
- amazon-web-services-(aws)
- augmented
- aws-lambda
- computer-vision
- face-recognition
- face-swapping
- ffmpeg
- generative-ai
- javascript
- machine-learning
- mediapipe
- opencv
- python
- react
- rest-api
- smart-glasses
- video-processing