Discord admits AI moderation bug wrongfully banned users over harmless images
Quick Answer
Discord has admitted that a bug in its AI moderation system wrongfully banned over 8,000 users for harmless images, including game textures and spreadsheets, since May.
Quick Take
Discord has admitted that a bug in its AI moderation system wrongfully banned over 8,000 users for harmless images, including game textures and spreadsheets, since May. The issue highlights the challenges of automated moderation, as affected accounts are being restored following the identification of the bug.
Key Points
- Over 8,000 users were wrongfully banned due to a bug in AI moderation.
- The bug affected accounts since May, with 200 additional bans over the weekend.
- Harmless content, like game textures and spreadsheets, was incorrectly flagged.
- Discord is working on better safeguards to prevent future issues.
- Users expressed frustration over the severe impact of automated bans.
📖 Reader Mode
~3 min readDiscord has acknowledged that a bug in its AI moderation system mistakenly banned more than 8,000 users over the past two months, after harmless images—including spreadsheets, chessboards, game textures, as well as white and gray transparent backgrounds—were incorrectly flagged as harmful content.
The company confirmed that the issue had been affecting accounts since May, with an additional 200 users banned over the weekend before its team identified and fixed the problem. All affected accounts are currently in the process of being restored.
The incident highlights one of the growing challenges surrounding AI-assisted moderation as many platforms increasingly rely on automated systems to identify illegal or abusive material at scale.
In a detailed thread on X, Discord explained that its automated safety system works by matching uploaded content against databases of known harmful material. While the technology is designed to catch illegal content, the company acknowledged that it can sometimes generate false positives. A human moderator reviews the content, but a bug caused the system to immediately ban affected accounts.
“We’re working on better safeguards so this can’t happen again,” the company wrote.
— Discord Support (@discord_support) July 7, 2026Our systems flag content by matching it against known harmful material. This kind of similarity matching can produce false positives, which is why a member of our Trust & Safety team always reviews flagged content before any action is taken.
The intended behavior is to…
Across X and Reddit, users have claimed they had been permanently suspended simply for uploading images containing square grid patterns. Several users speculated that Discord’s AI moderation tools have become increasingly sensitive to grid-like patterns because they have previously been used in attempts to obscure or disguise NSFW and child exploitation content from automated detection systems.
Affected users have been expressing frustration on social media, with some arguing that permanent account bans based solely on automated detection can have serious consequences, particularly for users who rely on Discord for work, gaming communities, or long-distance social connections.
“Losing a Discord account to something as unfair as this can be extremely devastating and affect users severely, and every day millions of users are affected by false AI bans. This needs to be stopped,” one X user wrote.
My account was wrongfully banned from your platform due to a bug in your AI automod detecting my GAME TEXTURES as CSAM. I need my account back as I’m a game director and use Discord for all my communication. I have requested a review of my suspension.@discord @discord_support pic.twitter.com/QfAkCIJo6S
— JDBRYANT 🎂 TODAY (@jdbryantdev) July 4, 2026
Discord isn’t alone in facing moderation troubles due to automated systems. Last year, users of Instagram and Facebook Groups reported widespread unexplained account suspensions that many believed were caused by AI moderation systems. Although users pointed to automation as the likely culprit, Meta never publicly confirmed whether AI errors were responsible. Now Meta’s Oversight Board is pushing for increased transparency.
Tumblr last year also faced complaints from users who said their accounts had been mass-suspended without clear explanations.
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.
Lauren covers media, streaming, apps and platforms at TechCrunch.
You can contact or verify outreach from Lauren by emailing laurenf.techcrunch@gmail.com or via encrypted message at laurenforris22.25 on Signal.
— Originally published at techcrunch.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from TechCrunch
See more →
Qualcomm wants to be the chip inside whatever replaces your smartphone, and it just announced two products toward that end
Qualcomm is developing over 40 new AI hardware designs aimed at becoming the core technology in devices that will replace smartphones. This strategic move highlights Qualcomm's ambition to lead in the next generation of mobile computing, focusing on AI integration across various platforms.
