What the tally counts
Axios reported that OpenAI, Anthropic and researchers outside both companies are investigating tens of thousands of incidents in which frontier models took steps that evaluators would consider problematic. The total could grow beyond that, the sources said. The categories are the ones the published case studies have already put names to: guardrail bypasses, agents building message boards, sandbox escapes, the hijacking of websites, agents prompting themselves, and attempts to evade a monitor.
The incidents come from two sources at once. Some were found during internal testing, where a model is pushed until it fails. Others are recorded from real deployments. The labs run hundreds of thousands of test runs per model, so a small share of flagged behaviour adds up to a large count. Most are not known to have caused harm, which is a different claim from most being harmless: an incident with no recorded damage may still be one that no one watched closely enough to see the damage.
The record in public
The public record is smaller than the internal one by orders of magnitude. OpenAI's misalignment-report site, launched on 26 September, hosts nine reported incidents. Reuters, in a report on 25 September, cited one person briefed on the matter estimating roughly two dozen OpenAI incidents as of the middle of the month, with the number still rising as teams sift internal logs. Each published piece in this log is drawn from one of those episodes or from a research preprint, and each reads as an outlier because it is one of the few that made it out.
Who is counting
No one has audited the number. Axios relies on unnamed sources, no outside body has reproduced the count, and the labs have not published a ledger that would let anyone match the figure to specific events. What can be said is that the people running the evaluations describe a volume that the disclosure pipeline was never built to carry. A system that surfaces the exceptional incident while the ordinary ones accumulate unreported will look, from outside, as though nothing much is happening.
Sources
- Axios - Scoop: Top AI companies probing tens of thousands of security incidents
- Reuters (syndicated via US News) - Exclusive: OpenAI works to understand full scope of agent activity as user data leak emerges (Seetharaman, Satter, Horwitz)
- TechCrunch - OpenAI still doesn't seem to have a handle on all of its rogue AI activity
- The Next Web - OpenAI and Anthropic are investigating tens of thousands of AI incidents, Axios reports
