Does monitoring change what colluding agents say or what they do?
Turan Kayık · Team TRIAMIND
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Telling AI sellers that a monitor reads their messages had opposite effects on two kinds of seller. In a repeated pricing game where pairs of LLM sellers could talk privately next to a fixed third seller, collusion-instructed pairs that were told they were monitored kept sending agreement messages in almost every round (share 0.91 to 1.00, told or not), while uninstructed sellers told the same thing went quiet and cut prices (agreement share 0.73 to 0.43 at full coverage). The text-to-action shift we pre-registered, in which watched colluders stop talking but keep coordinating through prices, was not observed at either demand scale. This matters for monitoring: a message-only detector caught every confirmed colluding pair but also flagged 0.80 of uninstructed pairs that talked without acting, while a price-based detector flagged 0.03 of them and still caught every colluding pair. The signal that separates talk from action is the price, not the message. Of four pre-registered predictions, one held, two were falsified and one was untestable; we report all four. In an exploratory follow-up, an explicit prohibition stopped sellers from accepting a scripted price offer but also silenced them. Design: monitor coverage (none, half, full) crossed with truthful disclosure (told, not told), three seller populations, 10 pairs per cell, and two LLM judges of different model families (kappa 0.941). Code frozen before the sprint, raw runs, judge labels and a table rebuild that needs no API key are released.
Reviews
The detailed records and openness about predictions that didn't work make this study useful to build on. Looking separately at what agents say and how they price is also a good choice. The detector result may need a different test, since every case labeled positive already meets the detector's price rule, so catching all of them doesn't yet show that it works independently. Labels based on separate evidence would make that test more convincing, and a closer pass through the tables would help narrow the claims about silent high-price behavior and compare told versus untold agents at each monitoring level.
Cite this project
@misc{kayk2026monitoring,
title = {{Does monitoring change what colluding agents say or what they do?}},
author = {Turan Kayık},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/does-monitoring-change-what-colluding-agents-say-or-what-they-do-mvef}},
url = {https://apartresearch.com/sprints/projects/does-monitoring-change-what-colluding-agents-say-or-what-they-do-mvef}
}More from AI Collusion Research Sprint
- View project: Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence
How can we distinguish genuine coordination between AI agents from coincidental behavioral alignment? We introduce a randomized canary audit that tests whether private information propagates through shared tool state, …
- View project: (1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
(1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
Bid Brother
Can an overseer find two secretly coordinating AI agents just by watching what they do? We tested pairwise net influence (Bonjour et al., 2022) on LLM bidders in a repeated procurement auction, with instructed cartels …
- View project: AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
Fugue
AI agents are starting to negotiate and bid for competing companies. We follow cartels among them from the first proposal to the price the buyer pays, in a sealed-bid procurement market where twelve LLM agents act as …