Home · Technology · Nov 21 archive

OpenAI Launches Tools to Combat AI-Generated CSAM

Confirmed

Technology Desk

In Short: OpenAI has released a new image classifier and in-chat warnings in ChatGPT to combat child sexual abuse material (CSAM).

OpenAI logo
Photo: OpenAI / Wikimedia Commons (Public domain)

On November 15, 2026, OpenAI announced a suite of tools aimed at detecting and preventing the creation and distribution of child sexual abuse material (CSAM) across AI platforms.

The centerpiece is an image classifier designed to detect CSAM, including images generated by AI. During early testing with partners, the classifier flagged 48% fewer images while identifying the same number of abusive images.

YouTube — AI Master YouTube

OpenAI is offering the classifier free through its API to vetted organizations, and it will be integrated into ChatGPT to show alerts to users attempting to access or generate such content.

Samuel Wang, Member of Technical Staff at SafetyKit, praised the classifier's performance, noting it catches unknown CSAM that hash matching misses, with false positives below 1% on legal adult content.

OpenAI is also providing guidance for API developers on integrating perceptual hash matching alongside classifiers for novel content, and working with the Tech Coalition and ROOST to share access.

OpenAI's efforts include a specific version of ChatGPT for teen users aged 13–17, launched in August 2026, with stronger safety protections and learning-focused features.

OpenAI's new framework for publicly disclosing AI misalignment incidents aims to set standards across the industry.

In a separate development, OpenAI announced that its swarm of 10,000 AI agents had solved the Navier-Stokes problem, one of the seven Millennium Prize problems, in less than four days.

At the United Nations, OpenAI's CEO Sam Altman and Anthropic's CEO Dario Amodei have urged for international coordination on AI development.

OpenAI's GPT-6 Astra, introduced on April 9, 2026, is being used to develop these new tools.

The FTC is investigating OpenAI, Anthropic, and METR over consumer risks from autonomous AI, with METR also a target.

OpenAI is pushing deeper into AI-enabled commerce, introducing dots agents during its annual developer conference in late September.

What this adds

OpenAI's new tools are designed to combat the strain on older safety tools due to AI-generated abuse material.

OpenAI's guidance for developers includes integrating perceptual hash matching alongside classifiers for novel content.

OpenAI's efforts are part of a broader initiative to strengthen online child protection and combat CSAM.

Background

OpenAI announced a suite of tools aimed at combating child sexual abuse material (CSAM) on November 15, 2026.

What's confirmed

What's still developing

Sources