ModQueue Copilot

Moderate smarter, not harder — real-time AI insights for Reddit moderators.

Comment

Inspiration

Reddit moderation is one of the most important, yet under-supported, workflows on the internet. Moderators make fast decisions under pressure, often with incomplete context.

While reviewing real posts and moderator workflow patterns, we saw the same issue repeatedly: suspicious content could slip through, harmless posts could be handled inconsistently, and context was often lost between moderators.

That exposed a deeper problem. Moderation is not only about detecting risky content. It is also about helping teams make consistent, explainable decisions inside a real workflow.

That insight led us to build ModQueue Copilot.

What It Does

ModQueue Copilot is a Devvit-based Reddit moderation assistant that helps moderators triage posts faster and make more consistent decisions.

It gives moderators direct tools inside Reddit to:

  • Analyze a Reddit post by URL or ID
  • Create demo cases for spam, promotion, questions, and discussion
  • Review a compact verdict card for a fast first read
  • Open a full moderation console for deeper review

The product recommends one of four moderator actions: approve, remove, review, or reply.

Beyond detection, it provides:

  • Clear risk verdicts with supporting reasoning
  • Structured moderator case files
  • Policy-aware decision comparison
  • Moderator handoff context and audit history
  • Impact metrics such as posts triaged and time saved

This turns moderation from reactive guesswork into a more structured, transparent workflow.

How We Built It

We built ModQueue Copilot as a full-stack Devvit application running inside Reddit.

  • Frontend: React-based moderation experience with a compact in-post card and a full console
  • Backend: Hono API with a deterministic moderation engine
  • Detection: Heuristic moderation signals such as urgency language, earnings claims, suspicious promotion patterns, and off-platform contact attempts
  • Workflow Design: A full moderation console organized around Overview, Controls, and Activity

The system works on real subreddit posts and also includes seeded demo scenarios with editable draft fields for reliable hackathon demos and judging.

Challenges We Ran Into

Working within Reddit platform constraints was a major challenge. Moderation flows depend heavily on where the app is installed and how moderators enter the workflow, so we had to design around real subreddit context, direct analysis entry points, and demo-safe flows.

Another challenge was balancing power with clarity. Early versions exposed too much at once. We refined the interface so moderators can first see the key call quickly, then move deeper into evidence, controls, and activity when needed.

We also spent a lot of time on trust. Instead of a black-box output, we made decisions visible through signals, case files, policy comparison, and audit history.

Accomplishments That We're Proud Of

  • Built a functional Devvit moderation assistant that runs inside Reddit
  • Created an end-to-end workflow that spans compact review, full console analysis, and action-taking
  • Designed a transparent moderation system with visible reasoning and structured evidence
  • Added policy-aware moderation views for different moderation styles
  • Built demo creation flows that are editable, reliable, and presentation-ready
  • Measured operational impact through triage counts, risk interception, and time-saved signals

What We Learned

Moderation is not only a classification problem. It is a workflow, trust, and coordination problem.

Accuracy alone is not enough. Moderators need clarity, consistency, and context they can hand off to the next teammate. In practice, explainability and workflow design matter as much as detection quality.

We also learned how much product quality depends on designing for real platform constraints, not idealized ones.

What's Next for ModQueue Copilot

Next, we want to evolve ModQueue Copilot into a broader moderation operations layer:

  • Stronger high-risk queue prioritization
  • Better moderator reply assistance
  • Deeper team-level insight and consistency tracking
  • Richer policy customization for different communities

Our goal is to make moderation faster, more consistent, and more scalable while keeping decisions transparent and human-centered.

Built With

Share this project:

Updates

posted an update —

If you want to see the full product flow, the complete 5-minute demo video is available here:

https://youtu.be/0ETbibjNNCk

It walks through direct analysis, demo-post creation, the compact verdict card, and the full moderation console across Overview, Controls, and Activity.

If you want a slightly stronger version:

For the full walkthrough, watch the complete 5-minute demo here: [add your video link]. It shows the end-to-end ModQueue Copilot workflow, from subreddit tools and demo drafting to the full moderation console, action flow, and audit trail.

Log in or sign up for Devpost to join the conversation.

posted an update —

ModQueue Copilot Update

ModQueue Copilot has moved beyond an early prototype into a Reddit moderation assistant designed around real moderator workflow inside Devvit.

What’s New

Direct subreddit tools for: Analyze Reddit post by URL or ID Create spam demo post Create promotion demo post Create question demo post Create discussion demo post One-click demo drafting with editable subject and body fields before opening a case Compact in-post card with Summary, Signals, and Actions for fast first-pass review Full moderation console organized into: Overview Controls Activity Overview now acts as mission control with: decision queue priority analytics snapshot policy comparison case file next-step guidance Controls supports: Setup for live Reddit post analysis by URL or ID Post for captured post context and evidence Reply & Action for separated moderation actions and moderator reply flow Activity tracks audit trail, handoff context, and recent moderation events Stronger moderation reasoning with visible signals and structured evidence Reliable seeded demo scenarios for testing, judging, and presentations Support for fresh scenario variants so demo drafts do not always repeat the same content Why It Matters Moderators lose time re-checking the same signals, repeating triage steps, and passing cases between teammates without enough context. ModQueue Copilot shortens that loop by giving moderators a clear verdict, visible reasoning, and operational workflow support directly inside Reddit.

The goal is faster, more consistent, and more transparent moderation.

Current Direction

Faster triage for busy mod teams Better trust through visible reasoning Cleaner moderator handoff through audit history Better demoability without fake or disconnected flows Demo Highlights

Launch subreddit tools directly from the installed app Open a draft dialog for spam, promotion, question, or discussion scenarios Edit the case before it is created Review the compact verdict card for a fast first read Open the full console for deeper analysis Use Overview, Controls, and Activity as one continuous workflow Take action without leaving Reddit Built With

Devvit React TypeScript Hono Vite Tailwind CSS Next Steps

More polish across moderator workflows Tighter demo packaging and submission presentation Continued tuning of moderation signals and decision quality ModQueue Copilot is built to make Reddit moderation feel less reactive and more operational.

Log in or sign up for Devpost to join the conversation.

posted an update —

ModQueue Copilot Update

ModQueue Copilot has evolved from a prototype into a full Reddit moderation assistant built for real moderator workflows inside Devvit.

What's New

  • Live post analysis inside the installed subreddit
  • Clear action recommendations: Approve, Remove, Review, and Reply
  • Transparent moderation reasoning with top risk signals
  • Stronger spam and scam detection for:
    • earnings claims
    • urgency language
    • off-platform contact attempts
    • suspicious promotion patterns
    • investment-style scam wording
  • Structured moderator case file with:
    • queue priority
    • evidence summary
    • next-step guidance
    • risk dimensions
  • Policy profile comparison to show how decisions change under different moderation styles
  • Activity history and impact metrics for operational visibility
  • Seeded demo scenarios for reliable testing and presentations
  • Compact in-post workflow plus a full moderation console

Why It Matters

Moderators lose time manually inspecting suspicious posts and repeating the same triage steps. ModQueue Copilot shortens that loop by giving moderators an instant verdict, clear reasoning, and direct moderation actions inside Reddit.

The goal is faster, more consistent, and more transparent moderation.

Current Direction

  1. Faster triage for busy mod teams
  2. Better trust through visible reasoning
  3. Measurable impact through time-saved and queue activity tracking

Demo Highlights

  • Analyze a live post directly from the post menu
  • Open the full moderation console for deeper review
  • Compare policy outcomes
  • Review the moderator case file
  • Take action immediately without leaving Reddit

Built With

  • Devvit
  • React
  • TypeScript
  • Hono
  • Vite
  • Tailwind CSS

Next Steps

  • More polish for moderator workflows
  • Better demo packaging and release presentation
  • Continued tuning of moderation signals and decision quality

ModQueue Copilot is built to make Reddit moderation feel less reactive and more operationally effective.

Log in or sign up for Devpost to join the conversation.

Submission history