Inspiration# Auto Product Commercial Generator

This application automates the process of creating product commercials by leveraging AI-generated content and user-provided assets.

Features

  1. LoRA Model Training: Train custom LoRA models using your own image datasets.
  2. AI Image Generation: Generate product images using trained LoRA models.
  3. Video Generation: Create dynamic product videos from generated images.
  4. B-roll Integration: Upload and incorporate B-roll footage into your commercials.
  5. AI Music Generation: Generate background music for your commercials using AI.
  6. Video Stitching: Combine product videos, B-roll footage, and music into a final commercial.

Installation

  1. Clone this repository:

    git clone https://github.com/yourusername/auto-product-commercial.git
    cd auto-product-commercial
    
  2. Install the required dependencies:

    pip install -r requirements.txt
    
  3. Set up environment variables: Create a .env file in the root directory and add the following:

    FAL_API_KEY=your_fal_api_key
    ANTHROPIC_API_KEY=your_anthropic_api_key
    

Usage

  1. Run the Gradio app:

    python app.py
    
  2. Open your web browser and navigate to the local URL provided by Gradio (usually http://127.0.0.1:7860).

  3. Follow the steps in the UI to:

    • Train a LoRA model
    • Generate images using the trained model
    • Create product videos
    • Upload B-roll footage
    • Generate background music
    • Stitch everything together into a final commercial

Components

  • app.py: Main application file containing the Gradio interface and core logic.
  • edit_picture.py: Image processing utilities.
  • flux.py: FluxImageGenerator for image generation.
  • runway.py: FalVideoGenerator for video generation.
  • suno.py: SongGenerator for AI music generation.
  • fal_train_lora.py: LoraTrainer for custom LoRA model training.
  • fal_lora_inference.py: FalLoraInference for generating images with trained LoRA models.

Dependencies

  • gradio
  • Pillow
  • moviepy
  • numpy
  • anthropic
  • (other dependencies as listed in requirements.txt)

License

MIT License

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

What it does

How we built it

Challenges we ran into

Accomplishments that we're proud of

What we learned

What's next for Auto Product Commercial

Built With

Share this project:

Updates