Inspiration

Reddit moderation is one of the most important — yet under-supported — workflows on the internet. Moderators make fast decisions under pressure, often with incomplete context.

While exploring real posts, we noticed a pattern: obvious spam or scam content sometimes slipped through, while harmless posts were removed. Decisions varied between moderators, and context was often lost between shifts.

This revealed a deeper issue: moderation is not just about detecting bad content — it’s about making consistent, explainable decisions as a team.

That insight led us to build ModQueue Copilot.


What it does

ModQueue Copilot is an AI-powered Reddit moderation assistant built with Devvit. It helps moderators triage posts faster and make more consistent decisions.

It analyzes posts directly inside a subreddit and recommends one of four actions: approve, remove, review, or reply — all without leaving Reddit.

Beyond detection, it provides:

  • Clear risk verdicts with supporting reasoning
  • Structured moderator case files
  • Policy-aware decision comparisons
  • Moderator handoff summaries
  • Impact metrics such as posts triaged and time saved

This transforms moderation from reactive guesswork into a structured, transparent workflow.


How we built it

We built ModQueue Copilot as a full-stack Devvit application running natively inside Reddit.

  • Frontend: React-based moderation console optimized for speed and clarity
  • Backend: Hono API with a deterministic moderation engine
  • Detection: Heuristic-based signals (earnings claims, urgency, external redirects, etc.)
  • Data: Redis for case history, activity tracking, and metrics

The system works on real subreddit posts and includes seeded demo scenarios for reliable hackathon demos.


Challenges we ran into

Working within Reddit’s platform constraints was a key challenge. Moderation actions are limited to the subreddit where the app is installed, which required careful design of entry points and demo flows.

Another challenge was balancing power with clarity. Early versions were feature-rich but too dense. We refined the interface to highlight critical signals — like risk level and key reasons — at a glance.

We also focused heavily on trust. Instead of a black-box classifier, we made every decision explainable and transparent.


Accomplishments that we're proud of

  • Built a fully functional Devvit app that runs inside Reddit
  • Enabled end-to-end moderation workflows in a single interface
  • Designed a transparent system with explainable decisions
  • Introduced policy-aware moderation for different subreddit styles
  • Measured real impact through risk detection and time savings

What we learned

Moderation is not just a technical problem — it’s a workflow and coordination challenge.

Accuracy alone isn’t enough. Moderators need clarity, trust, and consistency. Clear explanations and structured context often matter more than marginal improvements in detection accuracy.

We also learned to design within real-world constraints by building directly inside Reddit’s ecosystem.


What's next for ModQueue Copilot

Next, we aim to evolve ModQueue Copilot into a full moderation operations layer:

  • Prioritizing high-risk posts in the queue
  • Assisting with automated moderator responses
  • Providing deeper team-level insights and consistency tracking
  • Expanding policy customization for different communities

Our goal is to make moderation faster, more consistent, and scalable — while keeping decisions transparent and human-centered.

Built With

Share this project:

Updates

posted an update

ModQueue Copilot Update

ModQueue Copilot has evolved from a prototype into a full Reddit moderation assistant built for real moderator workflows inside Devvit.

What's New

  • Live post analysis inside the installed subreddit
  • Clear action recommendations: Approve, Remove, Review, and Reply
  • Transparent moderation reasoning with top risk signals
  • Stronger spam and scam detection for:
    • earnings claims
    • urgency language
    • off-platform contact attempts
    • suspicious promotion patterns
    • investment-style scam wording
  • Structured moderator case file with:
    • queue priority
    • evidence summary
    • next-step guidance
    • risk dimensions
  • Policy profile comparison to show how decisions change under different moderation styles
  • Activity history and impact metrics for operational visibility
  • Seeded demo scenarios for reliable testing and presentations
  • Compact in-post workflow plus a full moderation console

Why It Matters

Moderators lose time manually inspecting suspicious posts and repeating the same triage steps. ModQueue Copilot shortens that loop by giving moderators an instant verdict, clear reasoning, and direct moderation actions inside Reddit.

The goal is faster, more consistent, and more transparent moderation.

Current Direction

  1. Faster triage for busy mod teams
  2. Better trust through visible reasoning
  3. Measurable impact through time-saved and queue activity tracking

Demo Highlights

  • Analyze a live post directly from the post menu
  • Open the full moderation console for deeper review
  • Compare policy outcomes
  • Review the moderator case file
  • Take action immediately without leaving Reddit

Built With

  • Devvit
  • React
  • TypeScript
  • Hono
  • Vite
  • Tailwind CSS

Next Steps

  • More polish for moderator workflows
  • Better demo packaging and release presentation
  • Continued tuning of moderation signals and decision quality

ModQueue Copilot is built to make Reddit moderation feel less reactive and more operationally effective.

Log in or sign up for Devpost to join the conversation.