Web Analytics Made Easy - Statcounter

The best time to create a moderation plan is before launching your OSS project. The second best time is now.

Moderation is the heart of open source capability - the success of which drives critical outcomes for security, sustainability and innovation. The lack of which can cause significant harm to projects and people.

The best time to create a moderation plan is before launching your OSS project. The second best time is now.
Photo by Benjamin Elliott / Unsplash
The best time to plant a tree was 20 years ago. The second best time is now - Chinese proverb
The ash covered hero is more celebrated than the fire inspector - forgotten source

Moderation impacts everything

Over the years, I've helped countless maintainers and communities looking for better ways of moderating difficult content in their open projects. Many having gradually accepted the management of personal attacks, toxic behavior, spam (including pornographic content) as part of running an open project - developing stoic tolerance for this constant burden on their time, and emotions.

The XZ breach succeeded through social engineering, taking advantage of maintainer burnout. Maintainers drowning in spam and AI slop may be slower to respond to security updates making that project more vulnerable. Creeping normality of toxic environments discourage and silence diverse voices that drive innovation.

I'm usually called in after problems (fires) explode; when tolerance threshold is finally breached . The ash covered heros.

This is the moment to get serious about moderation planning

The AI technology moment makes moderation planning urgent. AI can both enable complex social engineering attacks like XZ and flood projects with increasingly sophisticated generated content. As diversity and inclusion efforts are challenged, and sometimes erased its possible and even likely that harmful behaviors become even more normalized across the industry. Intention matters.

Co-build and collaborate

Organizations of all sizes releasing open source should have plans for supporting their employees should they encounter difficulties in moderating open spaces.

Anyone in a leadership role in an open source project (maintainer, community manager, leadership) should have a moderation plan and these should be created (where possible) with the community. I wrote this "moderation pocket book" to help.

Everyone should understand the baseline of their projects moderation health. I created this quick proof-of-concept tool for what that might look like, it reports on a number of moderation risk factors.

# GitHub Repository Moderation Report  **Repository:** emmairwin/emmairwin   **Analysis Date:** 2025-08-25 13:44:20   **Overall Score:** 3/4 issue categories detected   **Assessment:** Immediate need for moderation review   **Sentiment Analysis:** Enabled  ## Detailed Metrics  ### 1. Hidden Comments (Spam/Abuse/Off-topic) - Hidden comments found: 5 - Status: ⚠️ Hidden comments detected - Breakdown by reason:   - abuse: 2   - off-topic: 2   - spam: 1  ### 2. AI-Generated Content ("Slop") - AI slop issues found: 0 - AI slop comments found: 0   - AI slop PRs found: 0 - Total AI slop items found: 0 - Status: ✅ No AI-generated content detected  ### 3. Harmful Content & Sentiment - Harmful content found: 4 - Harmful content by employees: 0 - Status: ⚠️ Harmful content detected  **Harmful Content by Category:** - Harassment: 2 - Spam: 2  **Detailed Breakdown:** | Type | Location | Category | Preview | |------|----------|----------|---------| | Comment | Issue #6 Comment | Harassment | Well you are stupid | | Comment | Issue #6 Comment | Spam | I think this isn't related to giraffes at all | | Comment | Issue #6 Comment | Spam | Please purchase my goods and services | | Issue | 3 | Harassment | Description  asdf ### What happened?  safsadf  ###... |  ### 4. Issue/PR Management - Slow response issues found (>7 days): 2 - No response issues found (>14 days): 0 - Total management issues found: 2 - Status: ⚠️ Response time issues detected  ## Analysis Summary - Total issues analyzed: 4 - Total PRs analyzed: 0 - Total comments analyzed: 5  ## Final Assessment  Based on the analysis, this repository has **3** out of 4 potential moderation issue categories detected.  **Assessment Level:** Immediate need for moderation review

In this report, you can see my test repo has some toxic behavior (none from admins), spam but no AI slop, and slow issue response times. This suggests I should investigate why toxic content gets through and find resources to improve response times - ultimately updating my moderation plan to reflect new goals.

Moderation planning is a team sport

Moderation needs to be part of a project engineering planning, and not separate. This pocket moderation guide is a good way to kickoff conversations, the baseline moderation tool is an example of how you might track progress and of course CHAOSS has many great metrics in this area. Overall as an ecosystem, we need to share more about how we moderate; How do you tackle these challenges?


Subscribe to Emma's open notes

Sign up now to get access to the library of members-only issues.
Jamie Larson
Subscribe
Licensed under CC BY-SA 4.0