Inspiration

Moderators deal with large volumes of posts every day, but most moderation tools still rely heavily on manual scanning and fragmented workflows. I wanted to create a system that visually prioritizes moderation decisions, explains why content was flagged, and helps moderators react faster without replacing human judgment.

ModPilot AI was designed as an intelligent moderation triage assistant for Reddit communities using Devvit.

What it does

ModPilot AI classifies posts into four moderation risk categories:

  • High Risk
  • Medium
  • Low Risk
  • Needs Review

The system analyzes moderation signals such as:

  • external links
  • promotional language
  • account age
  • low karma indicators
  • financial language
  • missing flair
  • urgency phrases

Each post receives:

  • a confidence score
  • detected moderation signals
  • threat visualization
  • AI recommendation
  • moderator action tools

Moderators can:

  • remove posts
  • approve posts
  • send warnings
  • move posts into review
  • reinstate removed posts

The interface was designed to feel fast, modern, and readable during high moderation activity.

How I built it

ModPilot AI was built using:

  • Devvit
  • Reddit Developer Platform
  • TypeScript
  • React-style Devvit components
  • Custom moderation scoring logic
  • Google Gemini AI (for plain-language summaries on medium/high risk posts)
  • Custom UI animations and moderation HUD design

The moderation system uses layered signal scoring to classify posts by risk level while maintaining moderator control over final actions.

Challenges I ran into

One of the biggest challenges was designing moderation workflows that felt intuitive while still looking visually polished and information dense. A significant challenge during final development was implementing proper server-side security, including moderator authentication, protected API endpoints, and secure API key management through Devvit's encrypted settings system. Balancing:

  • moderation clarity
  • signal visibility
  • UI responsiveness
  • action flow
  • visual hierarchy

was difficult during development.

Another challenge was making moderation states behave consistently when actions like remove, approve, and reinstate occurred across different queue states.

Accomplishments that I'm proud of

I am proud that ModPilot AI evolved into a complete moderation experience instead of only a basic dashboard.

Key accomplishments include:

  • fully interactive moderation flow
  • dynamic risk classification
  • custom moderation HUD styling
  • AI-assisted moderation recommendations
  • visual threat analysis system
  • moderator action tracking
  • secure moderator authentication and endpoint protection
  • premium cybersecurity-inspired interface design

What I learned

This project helped me better understand:

  • Devvit application structure
  • moderation workflow design
  • state management
  • UI/UX prioritization
  • moderation signal analysis
  • AI-assisted tooling concepts

I also learned how important moderation clarity and speed are for real communities.

What's next for ModPilot AI

Future plans include:

  • moderator analytics and moderation trend reporting
  • community-specific rule tuning and scoring profiles
  • persistent moderation history and audit tracking
  • collaborative moderation workflows
  • improved onboarding for new moderators
  • expanded AI-assisted moderation explanations
  • additional moderator feedback and usability testing

Built With

Share this project:

Updates

posted an update

Quick update on ModPilot AI.

Just completed another round of deployment, security, and workflow improvements.

Recent work included:

• Moderator authentication added to moderation data endpoints • Security hardening for queue and statistics access • Additional testing of approve, remove, warning, review, and undo workflows • Improved handling of moderation state changes • UI cleanup and launch-readiness refinements • Updated deployment and live environment verification

One of the biggest lessons during this stage was realizing that moderation tools are often judged by how predictable they feel rather than how many features they include. A large part of development became focused on making moderation actions behave consistently and ensuring the interface remained simple and readable.

The project has now moved beyond the original prototype stage and into a more stable testing phase. Current development is focused on reliability, workflow validation, and continued refinement of the moderation experience.

Building this as a first-time Devvit developer has been a good learning experience and has provided a much deeper understanding of moderation workflows, application security, and Reddit's developer ecosystem.

Log in or sign up for Devpost to join the conversation.

posted an update

Quick update on ModPilot AI.

Added Google Gemini integration for moderation summaries. Medium and high risk posts now receive a plain-language explanation describing why content was flagged — for example urgency language, suspicious external links, or promotional patterns.

Core moderation scoring remains fully rule-based. AI is only used to generate readable explanations for moderators. Final moderation decisions always stay human-controlled.

Also continued refining: • moderation queue workflow • action state handling • risk signal tuning • moderator UX polish • live testing environment

Building this publicly as a first-time Devvit developer has been a huge learning experience. Feedback from moderators and developers has been helping shape the project in real time.

App page: https://developers.reddit.com/apps/modpilot-ai GitHub: https://github.com/PrimeWolf-1/modpilot-ai

Log in or sign up for Devpost to join the conversation.

posted an update

ModPilot AI is now officially approved and published as an unlisted Devvit app.

Final polish included: • moderation workflow refinement • improved action state handling • risk classification cleanup • moderator interaction testing • updated live demo environment • Devvit publishing + deployment

Really proud of shipping this as a solo developer while learning the Reddit Devvit ecosystem in real time.

Live demo and app links are now available on the project page.

Log in or sign up for Devpost to join the conversation.