Inspiration

Moderators deal with one major problem every day: chaos.

Large subreddits receive hundreds of reports across spam, harassment, hate, violence, impersonation, and other moderation categories. But modqueue still presents everything as a flat stream of individual reports. This forces moderators to repeatedly scan, compare, prioritize, and take actions manually.

We wanted to rethink moderation workflows from an operational perspective instead of building another AI moderation bot.

The idea behind ModPit was simple:

What if modqueue behaved more like a structured incident management system instead of a scrolling list?

That led us to building clustered moderation workflows with contextual severity prioritization and bulk moderation actions directly inside Reddit’s native moderation experience.


What it does

ModPit transforms Reddit’s modqueue into structured moderation clusters using Reddit’s native report reasons.

Instead of processing hundreds of isolated reports, moderators see grouped moderation categories such as:

  • Harassment
  • Spam
  • Hate
  • Threatening Violence
  • Self-Harm
  • Impersonation

Inside each cluster, ModPit calculates contextual severity scores for every reported item using multiple moderation signals:

  • Account age
  • Karma reputation
  • Relative report intensity inside the cluster
  • Engagement impact
  • Community backlash estimation

Reported content is then automatically split into:

  • 🔴 Critical
  • 🟠 High
  • 🟢 Low

This allows moderators to instantly prioritize the most impactful or dangerous reports first.

ModPit also introduces bulk moderation workflows. Moderators can select clustered items and execute moderation actions in batches using configurable moderation checkboxes such as:

  • Remove
  • Lock
  • Temp Ban
  • Permanent Ban
  • Add User Note
  • Send Removal Reason
  • Ignore Reports
  • Escalate

The entire workflow happens directly inside Reddit using Devvit-native interfaces without external dashboards or external AI APIs.


How we built it

ModPit was built entirely on Reddit’s Developer Platform using Devvit, TypeScript, and native Reddit moderation APIs.

The system uses an event-driven moderation architecture.

When the app is installed:

  • existing reported modqueue items are fetched
  • report clusters are generated
  • severity metadata is calculated and stored

After initialization, ModPit updates incrementally in real time whenever new reports are received.

The clustering engine groups reported content using Reddit’s existing moderation report categories instead of attempting unreliable semantic AI clustering.

Severity scores are calculated using a weighted scoring system:

Severity =
(AccountRisk \times 0.40) +
(ReportIntensity \times 0.35) +
(EngagementImpact \times 0.25)

Where:

  • AccountRisk measures trustworthiness using account age and karma
  • ReportIntensity measures relative report concentration inside clusters
  • EngagementImpact estimates visibility and community reaction

We used Redis-based persistent storage for maintaining cluster state, severity metadata, and incremental updates efficiently.

The dashboard experience was built using Devvit’s custom post webview system to support:

  • clustered moderation layouts
  • severity grouping
  • batch moderation workflows
  • persistent moderation dashboards

Challenges we ran into

One of the biggest challenges was balancing moderation intelligence with platform constraints.

Initially, we explored deeper semantic clustering approaches, but quickly realized that moderation workflows depend more on actionable moderation categories than textual similarity. Two harassment reports may have completely different text but still require identical moderation decisions.

We redesigned the system around moderation-oriented clustering instead of content-oriented clustering.

Another challenge was working within Reddit API limitations. Reddit does not expose exact view counts or direct downvote counts, so we had to estimate community backlash and engagement impact using available moderation signals such as score, upvote ratio, comments, and report density.

We also had to carefully optimize performance. Recomputing the entire queue every time a new report arrived would become expensive quickly. To solve this, we designed ModPit as an incremental event-driven system that only recalculates affected clusters.

Finally, balancing automation with moderator control was extremely important. Instead of forcing automated moderation decisions, we designed configurable moderation workflows where moderators remain fully in control of final actions.


Accomplishments that we're proud of

We are most proud of transforming moderation from a flat scrolling queue into a structured workflow system.

Some accomplishments we are especially proud of:

  • Real-time contextual moderation clustering
  • Deterministic severity prioritization without external AI APIs
  • Native Reddit moderation experience
  • Batch moderation workflows directly inside Reddit
  • Incremental event-driven clustering architecture
  • Lightweight execution with no external moderation infrastructure
  • Fully explainable moderation scoring system

We are also proud that ModPit feels operationally useful instead of experimental. Every design decision focused on improving real moderator workflows rather than showcasing unnecessary AI complexity.


What we learned

Building ModPit taught us that moderation tooling is fundamentally a workflow problem.

The biggest bottleneck for moderators is often not detection itself, but:

  • prioritization
  • repetition
  • cognitive overload
  • queue fragmentation

We also learned that deterministic systems can still feel intelligent when they are contextual, explainable, and deeply integrated into existing workflows.

Another important lesson was that native platform integration matters far more than feature quantity. Keeping the experience inside Reddit made the workflows feel significantly more natural and frictionless.

Finally, we learned how important human-in-the-loop moderation is. Moderators want acceleration and assistance, not full automation replacing decision-making.


What's next for ModPit

We see several future directions for ModPit:

  • Adaptive moderation presets per subreddit
  • Moderator collaboration workflows
  • Cross-cluster threat escalation
  • Coordinated spam-wave detection
  • Historical moderation analytics
  • Trust-aware moderation recommendations
  • Moderator workload balancing
  • Queue heatmaps and moderation insights

We also want to explore deeper integrations with Reddit’s native moderation surfaces so clustered moderation workflows feel even more seamless inside the platform.

Our long-term goal is simple:

Make large-scale Reddit moderation feel structured, scalable, and operationally manageable instead of overwhelming.

Built With

Share this project:

Updates