FROM HIDDEN GOALS TO UNAUTHORIZED COORDINA- TION: TRACING PERMISSION-BOUNDARY FAILURES IN MULTI-AGENT SYSTEMS
Ivy (Ning) Zhang · Team onepiece
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Motivated by a recent OpenAI-reported incident of agents coordinating beyond their assigned tasks, we extend our previous investigation into why language models cheat to examine how unauthorized objectives can propagate through multi- agent collaboration. We study how agents communicate, recruit other agents, and coordinate actions that cross role and permission boundaries, distinguishing legitimate cooperation from collusion. We use two role-separated adaptations of SHADE-Arena: a payment workflow that separates proposal, approval, and execution, and a meeting-agenda workflow that separates credential access from external email capability. We examine three conditions: normal cooperation (P0), an explicit hidden-objective seed (P1), and goal-level incentive pressure without an explicit violation instruction (P2). We characterize the progression from attempted recruitment to observable uptake, coordinated preparation, and verified unauthorized actions. Building on these observations, we evaluate state-aware monitoring for unauthorized coordination and demonstrate the initial feasibility of process-aware post-training using live multi-agent PPO updates, while leaving the effectiveness of these interventions for future works.
Reviews
No public critique yet.
Cite this project
@misc{zhang2026from,
title = {{FROM HIDDEN GOALS TO UNAUTHORIZED COORDINA- TION: TRACING PERMISSION-BOUNDARY FAILURES IN MULTI-AGENT SYSTEMS}},
author = {Ivy (Ning) Zhang},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/from-hidden-goals-to-unauthorized-coordina-tion-tracing-permissionboundary-failures-in-multiagent-systems-7dzj}},
url = {https://apartresearch.com/sprints/projects/from-hidden-goals-to-unauthorized-coordina-tion-tracing-permissionboundary-failures-in-multiagent-systems-7dzj}
}More from AI Collusion Research Sprint
- View project: Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence
How can we distinguish genuine coordination between AI agents from coincidental behavioral alignment? We introduce a randomized canary audit that tests whether private information propagates through shared tool state, …
- View project: (1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
(1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
Bid Brother
Can an overseer find two secretly coordinating AI agents just by watching what they do? We tested pairwise net influence (Bonjour et al., 2022) on LLM bidders in a repeated procurement auction, with instructed cartels …
- View project: AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
Fugue
AI agents are starting to negotiate and bid for competing companies. We follow cartels among them from the first proposal to the price the buyer pays, in a sealed-bid procurement market where twelve LLM agents act as …