Filoli Nightfall

At Nightfall, the Trolls come to life.

Comment

Project Story — Filoli Nightfall Inspiration

Filoli Nightfall was inspired by the emotional presence of Thomas Dambo’s Save the Humans wooden troll sculptures and the magical atmosphere of the Filoli Gardens at dusk. Visitors to Filoli already experience a sense of wonder and awe when encountering the trolls, and I wanted to translate that feeling into a cinematic promotional piece that could amplify their annual Nightfall event. While participating in Black Mixture’s Advanced Generative AI course, I began exploring how generative tools could extend—not replace—traditional creative craft. This project became an opportunity to merge both worlds in service of Filoli’s brand of wonder, authenticity, and natural beauty.

What it does

Filoli Nightfall reimagines the static troll sculptures as expressive, lifelike characters who awaken after sunset and explore the gardens under starlight. The film serves as a marketing asset for Filoli, designed to capture the whimsy, atmosphere, and emotional tone of the trolls and the nighttime event. It gives audiences a cinematic and fantastical preview of the experience, blending magical realism with grounded, handcrafted authenticity.

How we built it

The project was created using a hybrid workflow that combined traditional filmmaking practices with advanced generative AI. I photographed each troll from multiple angles and used these images to train custom LoRA models, allowing the characters to be posed believably while preserving the details of their carved wood design. Location photographs from around the Filoli grounds were then composited with the posed trolls to establish cinematic start frames.

Using tools like Kling, Hailuo, and ComfyUI, I introduced subtle, controlled motion—camera movement, lighting shifts, and character actions—while maintaining the handcrafted realism of the sculptures. The final sequences were assembled, color-matched, scored, and finished in Adobe Premiere and Photoshop, resulting in a cohesive promotional film that supports Filoli’s marketing efforts.

Challenges we ran into Animating real sculptures into new real environments

The biggest challenge was integrating the trolls into new nighttime environments in a way that felt natural and organic. Because the trolls physically exist in the gardens, any animation had to respect their actual scale, material, texture, and interaction with light. Ensuring that they “belonged” in each new scene required careful compositing and tightly controlled AI-driven motion.

Minimizing generative AI hallucinations

Generative video systems often produce unintended distortions—shifting eyes, unstable textures, melting edges, or incorrect anatomy. Preventing these issues while keeping the trolls expressive required extensive iteration, thoughtful prompting, and strong scene structure. Every artifact was a cue for how to refine the next pass.

Accomplishments that we're proud of

We successfully created an animated marketing film that brings Filoli’s wooden trolls to life without compromising their handcrafted authenticity. The final piece maintains a consistent cinematic tone, integrates natural lighting and environmental realism, and reflects the emotional spirit of the Nightfall event. This project also demonstrates how generative AI can support—and expand—traditional filmmaking when used thoughtfully and intentionally.

What we learned

This project reinforced that generative AI is most effective when anchored by strong creative direction. Clear reference images, consistent lighting, and well-designed compositions significantly reduce unpredictability. I also learned that iteration is essential: each imperfect output sharpened the final results. Perhaps most importantly, the project showed that human craft and generative tools can work together to create new forms of cinematic storytelling that serve both artistic and marketing goals.

Built With

Share this project:

Updates