Plus Factors for Collusion Monitors: LLM Monitors Mistake Open Cooperation for Collusion
Jorge Vargas
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
LLM monitors are increasingly proposed to catch AI agents that collude, but agents that cooperate openly can look a lot like agents that collude. I introduce Séance, a four-player LLM guessing game in which a secret pair may pass information through public messages while honest players often share their information openly. On a held-out test set played by Qwen3.8-27B, I find that every LLM monitor I tested, from Qwen3.8-27B to Claude Opus 5.5, accuses most honest games when given a plain prompt, even though that prompt describes collusion as covert. Opus accused all 50 honest games while naming the colluding pair in every collusion game, which suggests that spotting coordination is easy and judging whether it is collusion is hard. Borrowing the "plus factors" that antitrust courts use to tell agreement from parallel conduct, I add one paragraph to the monitor's prompt that says open sharing is not evidence and lists what is. Without labeled data, it cuts false accusations for nearly every monitor (Qwen3.8-27B, 43 to 19 of 50), though most monitors also miss more real collusion. Switching model families or using calibrated decision models does not fix the problem. This failure stays invisible unless a monitor is tested on honest cooperation, so collusion monitors should be checked against such cases before anyone trusts them. I release Séance as the first game of a proposed benchmark of these hard negatives for collusion monitors.

Reviews
No public critique yet.
Cite this project
@misc{vargas2026plus,
title = {{Plus Factors for Collusion Monitors: LLM Monitors Mistake Open Cooperation for Collusion}},
author = {Jorge Vargas},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/plus-factors-for-collusion-monitors-llm-monitors-mistake-open-cooperation-for-collusion-vwz8}},
url = {https://apartresearch.com/sprints/projects/plus-factors-for-collusion-monitors-llm-monitors-mistake-open-cooperation-for-collusion-vwz8}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …