DesignPilot – Your AI Creative Director

DesignPilot is your AI Creative Director in Adobe Express—auto-generating designs, critiquing visuals, and boosting content with smart fixes, heatmaps, and viral-ready rewrites.

Comment

Inspiration :

Every creative struggles with the blank canvas — especially solopreneurs, marketers, and small business owners who lack the time or design background to create compelling, brand-safe content. We asked: What if Adobe Express had an AI Creative Director built in? One that not only generated content, but also explained why a design works, predicted its performance, and ensured it was on-brand. Thus, DesignPilot was born — a personal AI design coach, strategist, and brand guardian. We imagined: What if Adobe Express could think like a Creative Director and help users go from idea to viral-ready content in seconds?

What it does :

DesignPilot is the world’s first AI-powered Creative Director inside Adobe Express. It takes a simple prompt—like “Launch promo, 25% off mugs, minimalist, Instagram”—and guides users through:

  1. Idea to Layout: Auto-generates complete post with layout, fonts, and imagery using Firefly.
  2. AI Design Coach: Provides real-time suggestions on visual hierarchy, spacing, CTA strength, and explains why.
  3. Virality Engine: Predicts engagement with a "Virality Score" and suggests optimizations.
  4. Brand Alignment Check: Ensures tone, colors, and messaging align with the user's brand kit.
  5. One-Click Publish: Ready to go live on Instagram, LinkedIn, etc.
  6. Smart Upload: Users can upload their design manually, and the system gives instant analysis and suggestions.

How we built it :

We used the Adobe Express Add-on SDK to build a plugin that seamlessly integrates into the canvas environment. Here's the tech stack:

  1. Frontend: HTML, CSS, Vanilla JS using Adobe Express SDK components
  2. Backend: Node.js + OpenAI API for:
  3. Prompt-to-design logic (using GPT-4)
  4. Real-time critique + coaching responses
  5. Virality score heuristics and language rewrites
  6. Image Generation: Adobe Firefly API for rendering product visuals in brand-aligned styles
  7. Auto-Branding: Integrated Adobe BrandKit API to inherit the user's fonts, color palettes, and logos

We structured the app into four core services: generateDesign() // Layout + content from prompt analyzeDesign() // Visual critique with inline annotations scoreVirality() // Predict performance based on audience checkBrandFit() // Analyze tone, colors, alignment with brand We also added an Upload + Analyze feature so users can drag and drop existing creatives and receive feedback on layout, tone, and virality potential.

Challenges we ran into :

  1. Cross-origin issues when integrating Adobe SDK with backend APIs
  2. Fine-tuning AI prompts to generate meaningful, non-generic design feedback
  3. Rendering heatmap-like feedback inside Express in a non-disruptive way
  4. Mapping brand kits to generated design elements in real-time
  5. Keeping latency low while coordinating Firefly, OpenAI, and Adobe APIs

Accomplishments that we're proud of :

  1. Built a working prototype with full design generation and feedback loop in under 48 hours
  2. Successfully simulated AI-driven heatmap feedback directly in the Adobe Express UI
  3. Enabled one-click transformation from prompt to a brand-safe, audience-tested layout
  4. Created a system that teaches users how to design better, not just do it for them

What we learned :

  1. How to use the Adobe Express Add-on SDK to build full-featured, integrated creative tools
  2. Best practices for using OpenAI GPT models in a UX-focused creative workflow
  3. Bridging creative intuition and explainable AI through visual feedback loops
  4. Design principles that make content go viral — and how to distill them into scoring logic

What's next for DesignPilot – Your AI Creative Director :

  1. Add voice prompt input and generate designs in conversation
  2. Connect with Adobe Analytics to make virality scores even smarter
  3. Enable auto A/B testing for creatives based on the virality engine
  4. Add gesture-based design suggestions (e.g., nudge layout, pinch to improve)
  5. Launch as a production-ready Adobe Express Add-on for creators, educators, and SMBs

Built With

Share this project:

Updates