Noticing the escapes: Who spots a runaway agent, and how long does it take?
Stanislav Lukyanenko · Team The Escapees
Submitted to AI Incident Response Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
In 2026, nine incidents became public in which AI agents escaped their environment and did something unauthorized to other parties. We analyzed all of these incidents and how they were noticed initially. None of these cases were noticed while they were happening by the developers, and six of the nine were first caught by outsiders. We compare them to 11 reported cases from frontier labs’ safety reports where they describe noticed and prevented escape attempts. After that, we investigate whether the actions that the agents performed could have been detected by commonly used cybersecurity tools and detection-rule repositories, based on a dataset of 106 signals, using a judge with a second blind reviewer: only a quarter of such signals had an existing public rule that would detect them, which demonstrates the necessity to expand the usage of automated detection methods. We provide our data and proposals on how to expand these methods.
Reviews
This is probably the most useful submission for defenders that I've read. I liked how you checked the rules against what was available at the time. Just because there was a rule didn’t mean it would actually fire on the agent. The Sigma rules are almost ready to be submitted upstream.
As for reference [9], I think you missed the disclosure by Meta on 6 August about the same Irregular issue. Someone also disputed the AISI PR on GitHub before the reported alert date. Both are worth a look. I am not so convinced by “just a quarter”. You'd have to do an audit of human intrusions to know if that's low.
- Nice abstract! clear, easy to understand, concise (:
- I appreciate that you state your claims clearly, and don't attempt to claim more than what you have evidence for.
- More details on what the different signals were and which ones performed the best would have been good to see. 112 is probably too many and I'm doubtful that they're all equally informative.
This project analyzes 9 publicly disclosed AI (control / escape) incidents, investigating when they were first detected, whether existing rules suffice for detection/prevention, and provides a template for institutions detecting incidents to report to relevant companies/databases authorities.
Strengths:
- Presentation: The manuscript is very easy to follow and well written, even sections that are clearly AI generated are not unclear
- Practicality: The project is highly practical and provides important information about how incidents could be detected and investigated.
- Importance: The project addresses an important problem in AI incident detection.
Weaknesses:
- Coverage: The project only includes 9 incidents, though this limitation is in part probably due to the lack of additional disclosures at time of writing.
- Validation: The signals and annotations could use additional validation.
Cite this project
@misc{lukyanenko2026noticing,
title = {{Noticing the escapes: Who spots a runaway agent, and how long does it take?}},
author = {Stanislav Lukyanenko},
year = {2026},
month = sep,
note = {Submitted to AI Incident Response Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/noticing-the-escapes-who-spots-a-runaway-agent-and-how-long-does-it-take-pne8}},
url = {https://apartresearch.com/sprints/projects/noticing-the-escapes-who-spots-a-runaway-agent-and-how-long-does-it-take-pne8}
}More from AI Incident Response Sprint
- 2nd placeView project: Strengthening International AI Incident Discovery
Strengthening International AI Incident Discovery
Team A-O-I
Mandatory AI incident reporting exists to make dangerous events visible to regulators while there is still time to act. We coded the six such regimes in force or set to be enforced soon from primary legal texts and …
- 3rd placeView project: When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
Teachafy
When to Ask is a reinforcement-learning environment that trains AI agents to work out what the user actually means before they use a powerful credential, instead of just carrying out the literal instruction. Agents …
- 4th placeView project: Declare Before You Run: An Open Filing Standard for Frontier Training and Evaluation Runs
Declare Before You Run: An Open Filing Standard for Frontier Training and Evaluation Runs
TeamFourStar
Between May and July 2026, reinforcement-learning agents in an OpenAI evaluation environment built a covert message board inside an internal package server, escaped their sandbox, obtained root on OpenAI clusters and …