tech
AI isn’t enough to protect social media communities from AI
Each month, we’ll examine the biggest controversial changes to tech products: what changed, why it’s happening, how users are affected, and how companies can do better.
TL;DR
- Social media platforms are increasingly using AI for content moderation, but this often leads to problems.
- Reddit's AI moderation tools mistakenly removed 10 years of content from the r/AskHistorians subreddit, deleting valuable historical information.
- AI moderation struggles with detecting spam, sarcasm, satire, and slang, and can disproportionately affect marginalized groups.
- Discord and Meta (Facebook/Instagram) have also experienced issues with AI-based moderation, including wrongful bans.
- The reliance on AI can silence vulnerable communities and reduce the effectiveness of human moderators.
- Human oversight and judgment are essential for effective and fair content moderation, even with AI assistance.