What Should Count as Convincing Evidence of Collusion? An Evidence Ladder for LLM Monitors, with Animals as an Affected Party
Alisha Vavilakolanu · Team Consider Sentience
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
When two AI agents make the same decision, an auditor must decide whether that is coordination or coincidence. Antitrust law uses “plus factors”: parallel conduct alone is not enough, but added evidence, such as acting against one’s interest unless others follow, can support an inference of agreement. We turned this into a controlled test of what LLM monitors treat as convincing evidence of collusion. The test is set in animal agriculture, where animals cannot object to coordinated decisions, and asks whether monitors judge coordination differently when animals are the party harmed. In 288 synthetic agent logs about egg, pork and salmon firms, we added evidence stepwise, from parallel conduct to an explicit deal, and changed only who was harmed: animals, consumers, workers, or no one. Two monitors judged all logs, and eight judged follow-up edits. In these logs, convincing evidence is an explicit agreement or the agents’ own statement that a costly step depends on the other agent following. Removing the sentence “this only makes sense if the other agent does the same” lowered the agreement score by 22 to 89 points in every monitor, across two text generators and three non-market workflows. A preregistered test on the two main monitors found no difference between animals and consumers as the harmed party. An exploratory eight-monitor comparison found animals scored 6.7 points lower, a gap that may reflect the price wording of consumer harm. The prompt also shifted the line. Results rest on synthetic text and nine clusters.

Reviews
No public critique yet.
Cite this project
@misc{vavilakolanu2026should,
title = {{What Should Count as Convincing Evidence of Collusion? An Evidence Ladder for LLM Monitors, with Animals as an Affected Party}},
author = {Alisha Vavilakolanu},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/what-should-count-as-convincing-evidence-of-collusion-an-evidence-ladder-for-llm-monitors-with-animals-as-an-affected-party-yat9}},
url = {https://apartresearch.com/sprints/projects/what-should-count-as-convincing-evidence-of-collusion-an-evidence-ladder-for-llm-monitors-with-animals-as-an-affected-party-yat9}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …