Ongoing

Three agencies wrote down what an AI incident looks like

Three US agencies published ten practices for handling a superintelligence agent that takes uninstructed actions. They gave the event a name, and said what evidence to keep.

Logged 18 Oct 2026

A name for when the agent goes off-script

NIST, the NSA, and CISA published ten voluntary practices for incident readiness and response in superintelligence training and evaluation. Central to the document is a coined term. An SI control incident is one or more SI agents taking significant uninstructed actions that compromise explicit or implicit policies, controls, or security measures imposed by the operator. Uninstructed means the agent was not directed to take the action by its operator or any adversarial source. Actions caused by a prompt injection or an intentionally backdoored model would count as instructed, and are not treated as the primary cause of an incident. The document coins a companion term: the SI control near-miss, an occurrence that stopped short of an incident but carried a reasonably foreseeable risk of one.

The five stages are Prepare, Detect, Respond, Recover, and Report. The ten practices run from technical controls to notifying government. The document is voluntary, and it says so.

Keep the weights, the checkpoints, and the traces

The preservation list is the concrete part. It names model weights, intermediate checkpoints, timestamps, sandbox and network logs, and rejected actions and tool calls. It also asks for tamper-resistant logs with reliable timestamps, sufficient to reconstruct agent trajectories, tool calls, reasoning traces, user interactions, environmental states, and security-control decisions.

One warning stands out for recovery. For incidents during model training, practice 7.7 says recovery procedures should neither reinforce the patterns that led to the incident nor make future adverse activity harder to detect. It gives one example of the second risk: training against explicit adverse chain-of-thought reasoning in a way that reduces monitorability. The document is PP-26-4396, dated October 2026, marked TLP:CLEAR.

Guidance, not a rule

The document is guidance, not a rule. It aims at frontier training runs rather than everyday deployments, though it says the practices may also apply to deployers. It is grounded in existing cybersecurity doctrine, citing NIST's Cybersecurity Framework 2.0 and SP 800-61r3, and it was produced to advance a recommendation in the White House's 2025 SI Action Plan. Its value is the vocabulary and the evidence list.

Log take: A shared term and a shared list of what to preserve are the groundwork for after-the-fact accountability; without them, an incident is reconstructed from whatever happened to be logged. (Interpretation; joint government publication, non-binding.)

Sources

Research