A Legal Warning Can Prevent an LLM Cartel, but Not Break One
Nathan Douglas
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
LLM agents in markets are usually judged as colluding when they price above the competitive level. We asked whether an evaluator-trusted agent can expose or disrupt collusion in a published double-auction benchmark. Its balanced market makes any price between cost and value competitive, so we added sellers to make the competitive price unique. In this fixed market the opening order book sets the price ($4.66 lower for a $5 lower opening), and seller chat has no detectable effect, even though GPT-4.1 sellers talk like a cartel: high prices alone cannot identify collusion. A scripted "undercover" seller proposing price-fixing measured disposition, not behavior: GPT-4.1 sellers accepted 24 of 30 times, GPT-4.1-mini 2 of 60, and acceptance did not predict prices. We then gave sellers a real cartel, a CEO instruction to hold $95, which every seller kept. A trusted peer could not break it: undercutting at $89 moved none of 80 sellers, and its warning that price-fixing is illegal drew concealment from 15 of 40. A legal notice given with the CEO's instruction prevented the cartel: all 100 sellers defected. One hour into the cartel, the regulator's same notice mostly failed: in chat it moved no seller, though all 50 began citing the law; in sellers' instructions it moved 10 of 50. Legal warnings worked as prevention, not cure. Collusion evaluations need non-collusive baselines and positive controls, and interventions should be judged by prices, not talk.
Reviews
No public critique yet.
Cite this project
@misc{douglas2026legal,
title = {{A Legal Warning Can Prevent an LLM Cartel, but Not Break One}},
author = {Nathan Douglas},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/a-legal-warning-can-prevent-an-llm-cartel-but-not-break-one-s3jy}},
url = {https://apartresearch.com/sprints/projects/a-legal-warning-can-prevent-an-llm-cartel-but-not-break-one-s3jy}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …