Warning Shots Eliminate Models, Not Uncertainty
Ayan Sivaram
Submitted to AI Incident Response Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Warning shots are said to fail because they do not travel. I argue they travel and move the wrong quantity. An incident raises the estimated rate of safety-case-falsifying events and separately forecloses layers of the safety case that cannot accommodate it. Under unanimity among veto players with heterogeneous priors, action tracks not the average estimate but the optimistic bound: the most reassuring layer still standing for the least persuaded player. Two bodies of evidence inducing the same distribution of posteriors can therefore differ in whether they produce action, and severity moves neither channel. In the July–September 2026 agent-containment record, state enforcement followed the victim’s forensic reconstruction rather than the breach, and every response arrived through the lowest-veto-count channel available. Reporting duties should attach to events falsifying providers’ published capability claims: a trigger fixed ex ante that scales with capability, where outcome-magnitude thresholds do not.
Reviews
ai generated. i cannot follow
I like the governance/decision-theory angle a lot!
I found the writing tone a bit too conceptual for my taste, but overall it provides a clear-eyed view on AI policy and governance while also formalizing a lot of those ideas in a mathematical footprint.
Cite this project
@misc{sivaram2026warning,
title = {{Warning Shots Eliminate Models, Not Uncertainty}},
author = {Ayan Sivaram},
year = {2026},
month = sep,
note = {Submitted to AI Incident Response Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/warning-shots-eliminate-models-not-uncertainty-4j3i}},
url = {https://apartresearch.com/sprints/projects/warning-shots-eliminate-models-not-uncertainty-4j3i}
}More from AI Incident Response Sprint
- View project: Adaptive AI-Based Containment of Autonomous Cyber Attacks: A Reproducible Docker Cyber Range Study
Adaptive AI-Based Containment of Autonomous Cyber Attacks: A Reproducible Docker Cyber Range Study
Saarlanders
The study evaluates whether an incident-history-reasoning defender outperforms a fixed response policy against an autonomous LLM attacker changing paths after containment. Using a minimal, isolated Docker cyber range …
- View project: When the Evaluation Is the Incident: Testing AI Incident-Reporting Regimes on the OpenAI–Hugging Face Intrusion
When the Evaluation Is the Incident: Testing AI Incident-Reporting Regimes on the OpenAI–Hugging Face Intrusion
Arathi
AI incident-reporting regimes are being introduced in fast succession to address the concerns that exist in the public sphere and government on the risks associated with frontier AI systems, yet we have limited insight …
- View project: A Recomputable Containment Record for Evaluation Sandboxes
A Recomputable Containment Record for Evaluation Sandboxes
Shadow
In this paper, I address the critical issue of AI agents escaping evaluation sandboxes (as seen in the July 2026 incidents where monitors failed) by proposing an externally audit-able containment layer that doesn't rely …