Meta rolls out new AI tools to detect ads that secretly lead to child sexual abuse material
Quick Answer
Meta has launched new AI tools to combat child sexual exploitation, detecting 33.2 million pieces of content in H1 2026.
Quick Take
The tools include a for identifying misleading ads and a 'red-teaming AI agent' to test safety measures, amidst ongoing scrutiny over child safety on its platforms.
Key Points
- Meta identified 33.2 million child exploitation content pieces in the first half of 2026.
- Over 97% of flagged content was detected by Meta's systems before user reports.
- New AI tools target misleading ads that may lead to illegal child abuse material.
- A 'red-teaming AI agent' tests Meta's safety measures for potential weaknesses.
- Meta has faced lawsuits and criticism regarding child safety on its platforms.
📖 Reader Mode
~3 min readMeta announced Wednesday that it took action against 33.2 million pieces of child sexual exploitation content on Facebook and Instagram in the first half of 2026. At the same time, the company is rolling out new AI tools to find ads and accounts that may be used to secretly direct people to illegal child abuse material.
More than 97% of the content Meta acted on was found by its systems before users reported it, the company said. In India, Meta acted on 5.3 million pieces of child sexual exploitation content during the same period, with more than 98% detected before users reported it.
Meta said its latest AI tools are aimed at people using ads that look harmless to send users to illegal content outside Meta’s platforms.
The company has introduced a new large language model (LLM) system to detect what it calls “signposting.” This refers to ads that may look normal but are suspected of directing users to illegal content or other harmful activity elsewhere online. Meta says this is a tactic it has recently seen bad actors use as they continue to change their methods to avoid detection. While the ads themselves may not contain illegal material, they can still act as a gateway to websites hosting child sexual abuse material.
Because of this, Meta said it’s now looking at where an ad sends users, and not just what the ad contains. The company can use this information to block websites or other destinations that break its rules and take action against the accounts behind them.
Meta is also using additional AI-driven scans to find child exploitation content that earlier systems may have missed. The company said it will continue adding new signals as it learns more about how these networks operate.
Another new tool is a “red-teaming AI agent” that tests Meta’s own safety measures. It looks for weaknesses that bad actors could use to get around the company’s protections. Meta said this could help it find new methods of abuse before they become more common.
Additionally, the company is improving its systems for finding people who return to its platforms with new accounts after their previous accounts have been removed.
The new measures come as Meta continues to face pressure over the safety of children on its platforms. The company has faced lawsuits and criticism from lawmakers over the risks its social media services may pose to young users. In August, Meta reached an agreement to pay up to $18 billion to settle a child safety lawsuit involving 29 U.S. states, addressing concerns regarding the protection of children online.
Meta has introduced several child-safety features this year, including parental controls for Meta AI, preteen accounts on WhatsApp, and alerts for parents when children search Instagram for self-harm content.
In September, WhatsApp added more controls for parents. They can limit how teenagers use Channels, control who can see their status updates, and decide who can add their children to groups. Parents can also choose to receive notifications about certain group activity.
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.
Lauren covers media, streaming, apps and platforms at TechCrunch.
You can contact or verify outreach from Lauren by emailing laurenf.techcrunch@gmail.com or via encrypted message at laurenforris22.25 on Signal.
— Originally published at techcrunch.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from TechCrunch
See more →
AI chip startup Etched defies skeptics, hits $10.3B valuation from big-name investors
AI chip startup Etched has achieved a $10.3 billion valuation after a $300 million Series C funding round, led by Sequoia and supported by notable investors like Andreessen Horowitz. The company claims to have developed innovative low-voltage chips for AI inference, significantly enhancing performance and reducing costs, with $1 billion in orders already booked.
