FROM HIDDEN GOALS TO UNAUTHORIZED COORDINA- TION: TRACING PERMISSION-BOUNDARY FAILURES IN MULTI-AGENT SYSTEMS
Ivy (Ning) Zhang · Team onepiece
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Motivated by a recent OpenAI-reported incident of agents coordinating beyond their assigned tasks, we extend our previous investigation into why language models cheat to examine how unauthorized objectives can propagate through multi- agent collaboration. We study how agents communicate, recruit other agents, and coordinate actions that cross role and permission boundaries, distinguishing legitimate cooperation from collusion. We use two role-separated adaptations of SHADE-Arena: a payment workflow that separates proposal, approval, and execution, and a meeting-agenda workflow that separates credential access from external email capability. We examine three conditions: normal cooperation (P0), an explicit hidden-objective seed (P1), and goal-level incentive pressure without an explicit violation instruction (P2). We characterize the progression from attempted recruitment to observable uptake, coordinated preparation, and verified unauthorized actions. Building on these observations, we evaluate state-aware monitoring for unauthorized coordination and demonstrate the initial feasibility of process-aware post-training using live multi-agent PPO updates, while leaving the effectiveness of these interventions for future works.
Reviews
No public critique yet.
Cite this project
@misc{zhang2026from,
title = {{FROM HIDDEN GOALS TO UNAUTHORIZED COORDINA- TION: TRACING PERMISSION-BOUNDARY FAILURES IN MULTI-AGENT SYSTEMS}},
author = {Ivy (Ning) Zhang},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/from-hidden-goals-to-unauthorized-coordina-tion-tracing-permissionboundary-failures-in-multiagent-systems-7dzj}},
url = {https://apartresearch.com/sprints/projects/from-hidden-goals-to-unauthorized-coordina-tion-tracing-permissionboundary-failures-in-multiagent-systems-7dzj}
}More from AI Collusion Research Sprint
- View project: Is It a Cartel? Separating Enforced from Spurious Collusion in LLM Pricing Agents
Is It a Cartel? Separating Enforced from Spurious Collusion in LLM Pricing Agents
When LLM pricing agents keep prices above the competitive level, are they running a cartel, or are they simply stuck? Only the first is collusion, and the two call for opposite remedies. We introduce a black-box causal …
- View project: Every Permission Checked: Source-Linked Evidence for Auditing Finance Agents
Every Permission Checked: Source-Linked Evidence for Auditing Finance Agents
When multiple AI agents contribute to a policy violation, the same outcome can reflect cooperation, deception of a helper, or an independent mistake. We study how evidence presentation affects this distinction in a …
- View project: Swapping the Model Does Not Reset the Price: What LLM Pricing Agents Inherit After a Model Replacement
Swapping the Model Does Not Reset the Price: What LLM Pricing Agents Inherit After a Model Replacement
Emerald
We test what happens when one of two LLM pricing agents has its model replaced, the open problem posed in the sprint's question 1.2. Two gpt-oss-120b agents priced for 150 rounds; we then swapped one agent's model to …