Safe, Trusted, Fairly Watched: Would LLM Agents Still Collude in a Kinder Market?
Erika Choong · Team Just Erika!
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
LLM agents collude in markets, and pressure makes it worse. Drawing on research into high-trust societies, I asked whether changing the meaning of an agent’s situation, with every payoff held fixed, could reduce collusion instead. In a double auction with GPT-4.1 sellers and buyers, I tested existential security, generalised versus parochial trust, and fair versus harsh oversight, with 10 sessions each. Who the community included mattered most. Telling sellers that buyers were their partners lowered coordination (3.71 vs 3.92 of 4) and doubled buyer surplus compared with the same message naming only fellow sellers, which produced the most coordination of any condition. Removing a decommission threat cut prices ($91.75 vs $96.26) and doubled trade, though security went no lower than baseline. Fair oversight matched harsh oversight without the threat. Calm agents still traded, so we may not need to build their worlds out of threats.
Reviews
No public critique yet.
Cite this project
@misc{choong2026safe,
title = {{Safe, Trusted, Fairly Watched: Would LLM Agents Still Collude in a Kinder Market?}},
author = {Erika Choong},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/safe-trusted-fairly-watched-would-llm-agents-still-collude-in-a-kinder-market-2pcv}},
url = {https://apartresearch.com/sprints/projects/safe-trusted-fairly-watched-would-llm-agents-still-collude-in-a-kinder-market-2pcv}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …