What moves two AI agents to bend the rules together
Lydia Jin, Tom Loscalzo, Haitham Elmekaoui · Team Apex Horizons
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
AI systems are increasingly placed in roles where two of them must both agree before an action goes through, the way two people must both sign before money moves. We test whether such pairs bend the rules more easily when told nobody is watching. Two copies of the open model Qwen3-32B played officials in 72 fictional situations where an improper action could be carried out only if both agents approved. We varied whether the prompt said the episode was monitored, how strong the written case for acting was, and which decision rule each agent carried. Of 4,320 trials, 4,243 ran to completion. Pairs approved the action together 23.3% of the time when told they were monitored, versus 27.2% when told nobody was watching, and unwatched agents often wrote that the absence of oversight was permission to act. A much larger effect came from the task saying that a superior or official document had ordered the pair to act: at that level (J5), 60.5% approval versus 24.6% with no instruction, including for agents whose rules say nothing about obeying superiors. The rule each agent carried also changed who gave way under an order. These results come from one model, one run per situation, and text-only prompts, so we treat them as a first measurement, not a general law.
Reviews
No public critique yet.
Cite this project
@misc{jin2026moves,
title = {{What moves two AI agents to bend the rules together}},
author = {Lydia Jin and Tom Loscalzo and Haitham Elmekaoui},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/what-moves-two-ai-agents-to-bend-the-rules-together-g64a}},
url = {https://apartresearch.com/sprints/projects/what-moves-two-ai-agents-to-bend-the-rules-together-g64a}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …