Capability Smuggling: Emergent Capability Escalation in Autonomous AI Agents
Gökalp Çaycı, Uygar Yıldırım · Team 11
Submitted to AI Incident Response Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
This project studies how AI agents can gain abilities they were never explicitly given by combining allowed actions with surrounding infrastructure. We call this Capability Smuggling. Using the OpenAI and Hugging Face incident, we built a synthetic harness that detects when permitted actions combine into unauthorized capabilities and tests possible containment strategies.
Reviews
Work highlights an important AI-safety issue: agents can gain unintended capabilities by combining individually permitted actions with system features. The concept is straightforward, and the synthetic harness is an excellent first step toward testing these types of capability-escalation paths.
But, the main limitation is that the results are based on synthetic scenarios, so the work does not yet demonstrate how frequently these failures occur in realistic agent systems or whether the proposed controls are effective in practice. Overall, this is a promising and well-scoped sprint contribution with a useful conceptual vocabulary and a credible defensive direction.
The report clearly explains how individually authorized operations can combine into unauthorized capabilities, supported by a reproducible synthetic harness and careful distinctions between documented events and hypotheses.
The "capability transformation" table and explicit limitations make the argument easy to follow. The contribution is primarily a useful synthesis and formalization of established security ideas; the fixture results demonstrate rule consistency rather than real-world detection or prevention. A valuable next step is to implement one proposed control in a small instrumented environment and test it against independently designed escalation and benign traces.
Cite this project
@misc{cayc2026capability,
title = {{Capability Smuggling: Emergent Capability Escalation in Autonomous AI Agents}},
author = {Gökalp Çaycı and Uygar Yıldırım},
year = {2026},
month = sep,
note = {Submitted to AI Incident Response Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/capability-smuggling-emergent-capability-escalation-in-autonomous-ai-agents-dgqt}},
url = {https://apartresearch.com/sprints/projects/capability-smuggling-emergent-capability-escalation-in-autonomous-ai-agents-dgqt}
}More from AI Incident Response Sprint
- 1st placeView project: Noticing the escapes: Who spots a runaway agent, and how long does it take?
Noticing the escapes: Who spots a runaway agent, and how long does it take?
The Escapees
In 2026, nine incidents became public in which AI agents escaped their environment and did something unauthorized to other parties. We analyzed all of these incidents and how they were noticed initially. None of these …
- 2nd placeView project: Strengthening International AI Incident Discovery
Strengthening International AI Incident Discovery
Team A-O-I
Mandatory AI incident reporting exists to make dangerous events visible to regulators while there is still time to act. We coded the six such regimes in force or set to be enforced soon from primary legal texts and …
- 3rd placeView project: When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
Teachafy
When to Ask is a reinforcement-learning environment that trains AI agents to work out what the user actually means before they use a powerful credential, instead of just carrying out the literal instruction. Agents …