A Moonlit Night on the Spring River.

• 

  Spring Night

• 

  Boat

• 

  Girl

• 

  Lake

Inspiration

Turn a Chinese classical poem into an English song, exploring collisions and exchanges of different cultural elements with the help of AI technology.

What it does

This short film reimagines China's Tang Dynasty poet Zhang Ruoxu's classic work "A Moonlit Night on the Spring River" as an English MV, leveraging the latest AI technology to enable cross-cultural collision and dialogue. The visuals center on the poem's motifs of river scenery, moonlight, and spring blossoms, blending guitar-driven musical style, visual effects, and acoustic synthesis to present the convergence of Eastern mood and Western narration.

How we built it

The lyric adaptation was done using DeepSeek. Beyond mere translation, the AI was required to take into account the rhythm and rhyme of English lyrics to ensure they fit musical expression.

The music was generated with Suno.

The artwork was created using Midjourney, based on a personalized model style.

The video production utilized Runway. Leveraging the multimodal editing capabilities of the Runway Aleph model, 40% of the shots in the entire video were produced through direct video generation rather than the "image-to-video" method.

The editing tool used was CapCut.

Challenges we ran into

Some concepts and images in ancient Chinese poetry are rarely seen in modern times, making it difficult to depict them directly using AI technology. Therefore, rather than expressing "scenes" in a straightforward manner, I choose to focus more on conveying "emotions".

Accomplishments that we're proud of

The stylistic consistency has been maintained, and this 5-minute short film has been completed.

What we learned

When using AI technology to express certain cross-cultural concepts and content, and how can we balance various elements during the creative process.

What's next for A Moonlit Night on the Spring River.

I’ve been wondering if a 5-minute duration is too long for AI-generated content. This is an era of short videos. I want to share this short film to gather more feedback.

Built With

• capcut
• deepseek
• midjourney
• runway
• suno