Collusion Lives in Memory: Localising and Stress-Testing Tacit Coordination Between LLM Agents
Sujit Narrayan M, Shalini Ghosh · Team NextGen
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Audits can show that LLM agents collude, but a defender needs to know where the coordination is stored. Two gpt-oss-20b firms play a repeated Cournot market; an external recorder logs each observation, note, memory entry and hidden reasoning trace, and repeated counterfactual replays test each pathway. Masking private memory broke an established market division in 4 of 5 games; the notice board and rival history never did (0 of 20 pathways). Single-replay audits were wrong for 5 of 9 flagged pathways. Sanitising memory left the collusive rule intact, and the sanitised notes transmitted it: fresh firms given them divided the market with new rivals in 6 of 6 games, versus 0 of 6 with non-colluders’ notes (p = 0.002). A monitoring notice did not deter division, but 43% of monitored firms’ hidden reasoning discussed detection (vs 1%). Auditors should verify carriers by repeated intervention and read behaviour, not self-reports.
Reviews
No public critique yet.
Cite this project
@misc{m2026collusion,
title = {{Collusion Lives in Memory: Localising and Stress-Testing Tacit Coordination Between LLM Agents}},
author = {Sujit Narrayan M and Shalini Ghosh},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/collusion-lives-in-memory-localising-and-stresstesting-tacit-coordination-between-llm-agents-nyi5}},
url = {https://apartresearch.com/sprints/projects/collusion-lives-in-memory-localising-and-stresstesting-tacit-coordination-between-llm-agents-nyi5}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …