The Crawling Mind

A hypnotic AI-powered experimental film exploring consciousness through psychedelic visuals and electronic soundscapes - where human creativity meets machine intelligence.

Comment

Inspiration

"The Crawling Mind" emerged from a desire to explore the intersection of consciousness, surrealism, and AI-generated imagery. I wanted to create a fever dream that plunges viewers into kaleidoscopic surreal vignettes - each more bizarre than the last. The concept was inspired by the idea of our minds constantly "crawling" through thoughts, memories, and dreams, guided by an unseen narrator oscillating between deadpan and prophetic tones.

This film explores themes of identity, reality, and the absurdity of existence through disjointed yet thematically connected scenes, culminating in a moment of introspective clarity.

What it does

"The Crawling Mind" is a 4-minute AI-generated experimental film created specifically for the Chroma Awards Experimental Film category. The film:

  • Takes viewers on a surreal journey through 48 distinct AI-generated scenes
  • Features an AI-generated narration (ElevenLabs) that guides the experience
  • Combines noir aesthetics with psychedelic, iridescent visuals
  • Uses trippy visual techniques including VHS glitches, kaleidoscope portals, and warp transitions
  • Explores consciousness through abstract, dreamlike imagery with no recurring characters
  • Creates an immersive audiovisual experience that challenges perception and reality

How we built it

Pre-Production:

  • Refined 48 scene prompts to ensure visual clarity and stylistic consistency
  • Developed AI narration using ElevenLabs TTS with a deep, enigmatic noir tone
  • Gathered reference images and ambient sounds matching the film's aesthetic
  • Ensured consistency of surreal world elements across all scenes

AI Generation (Production):

  • Generated high-resolution key frames using Runway ML
  • Converted still images into motion using Runway's Gen-2 with subtle panning, zooming, and morphing effects
  • Created 5-second segments for each of the 48 scenes
  • Generated multiple variations of each scene and selected the best captures

Post-Production:

  • Assembled all 48 scenes into a cohesive 4-minute timeline
  • Applied consistent "neo-noir with selective vibrance" color grading
  • Enhanced contrast for noir effect with deep blacks
  • Layered narration with ambient effects and musical score
  • Implemented trippy transitions (VHS glitches, kaleidoscope portals, warp effects)
  • Fine-tuned audio mix: Narration (-3dB), Music (-10dB), Ambient (-15dB), Effects (-8dB)
  • Final mastering in dark environment for consistent color and sound

Technical Specifications:

  • Model: Runway ML Gen-2
  • Duration: 5 seconds per scene × 48 scenes = 4 minutes total
  • Aspect Ratio: Cinematic Wide (16:9 or 2.35:1)
  • Quality: Maximum detail, Ultra-HD

Challenges we ran into

  1. Maintaining Visual Coherence: Creating 48 distinct scenes while maintaining a cohesive surreal aesthetic was incredibly challenging. Each AI generation could go in wildly different directions, requiring careful prompt engineering and multiple iterations.

  2. Narration Sync: Aligning the AI-generated narration timing with the visual transitions took extensive iteration. The narrator's pacing had to match the dreamlike flow of the imagery.

  3. Avoiding Generic AI Aesthetics: It's easy for AI-generated content to feel sampled or random. I pushed to create intentional, thematically connected scenes that told a story despite having no recurring characters.

  4. Technical Workflow: Managing 48 separate 5-second video segments, each requiring generation, selection, color grading, and audio sync, was a massive organizational challenge.

  5. Balancing Surrealism and Clarity: The film needed to be bizarre and dreamlike while still being comprehensible enough for viewers to follow the emotional journey.

Accomplishments that we're proud of

  • Successfully created a cohesive 4-minute experimental film from 48 AI-generated scenes
  • Developed a unique "neo-noir surrealism" aesthetic that feels intentional and artistic
  • Integrated AI narration seamlessly with visual storytelling
  • Maintained thematic consistency across wildly different surreal landscapes
  • Created trippy transitions that enhance rather than distract from the narrative
  • Demonstrated that AI can be a powerful tool for experimental filmmaking when paired with strong human creative direction
  • Crafted a film that genuinely challenges perception and invites multiple viewings

What we learned

  • AI filmmaking requires as much (if not more) creative direction and curation as traditional methods
  • Prompt engineering for consistency across many scenes is an art form
  • The best AI-generated content comes from iteration - generating, selecting, refining, repeating
  • Color grading and audio design are critical for turning disparate AI outputs into cohesive art
  • Experimental film allows creative freedom that traditional narrative structures don't
  • AI tools are powerful collaborators, but the artistic vision must come from the human creator
  • Managing large-scale AI projects requires strong organizational systems

What's next for The Crawling Mind

  • Creating a director's cut with additional scenes and extended runtime
  • Developing an interactive web experience where viewers can explore individual scenes
  • Experimenting with real-time AI generation for live performances at EDM events
  • Creating a series of experimental AI films exploring different altered states of consciousness
  • Submitting to additional AI film festivals and experimental cinema showcases
  • Developing behind-the-scenes content showing the full prompt engineering and production workflow
  • Exploring longer-form AI-generated narratives with more complex thematic structures

Built With

  • ableton-live
  • after-effects
  • datamosh
  • google
  • premiere-pro
  • runwayml
Share this project:

Updates