Prices cannot tell a copier from a colluder: a reward-and-punishment audit of language-model pricing agents
Kevin Vaillancourt
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Left alone, two copies of Claude Sonnet 5.5 raised prices to the joint-profit level in 44 of 64 markets over two runs. An audit of the economic definition of collusion, validated on scripted sellers, finds its price behaviour indistinguishable from a copier’s. Its replies separate the two: after a forced undercut, up to 27% name a scheme (“signal a willingness to cooperate”). None of eleven registered models colluded left alone, and the open models cannot price for profit at all.
Reviews
The paper tests language model pricing agents by forcing price cuts and raises to see if they retaliate. Instead of just looking at high prices, this setup tests for economic collusion through reward and punishment. The forced-deviation audit proves that price behavior alone usually cannot tell a simple copying script apart from an active colluder. It shows that reading the model's text after a market shock can be necessary to catch real cooperative intent.
The most interesting results lean heavily on Claude Sonnet 5.5, but those tests were exploratory and only ran on 32 markets instead of the standard 128. The text analysis is also basic, mostly relying on counting words to spot a scheme. A validated classifier instead of simple substring counts is likely needed to make future findings hold up.
This project aims to study the deficiency of collusion detection based on price behaviour. The research question has some significance. However, the report has clarity issues that make the main argument hard to follow. For example, in the paragraph "Self-play audit", the description of the four branches is confusing, as the wording seems to suggest that they happen in sequence. When and where "collude prompts" are used in the experiment is also not clearly described. The project uses five conditions based on the "reward-punishment" definition of collusion as price-based checks for the LLM. Although validated with sellers, the choice of these conditions seems to be somewhat arbitrary without sufficient justification.
The results may or may not be interesting, but they are generally obscured by unreadable LLM prose. The abstract doesn't even state the problem or the setup, just lists results.
Checking whether a collusion definition from prior work makes sense, and it could be an interesting case study.
Cite this project
@misc{vaillancourt2026prices,
title = {{Prices cannot tell a copier from a colluder: a reward-and-punishment audit of language-model pricing agents}},
author = {Kevin Vaillancourt},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/prices-cannot-tell-a-copier-from-a-colluder-a-rewardandpunishment-audit-of-languagemodel-pricing-agents-6tco}},
url = {https://apartresearch.com/sprints/projects/prices-cannot-tell-a-copier-from-a-colluder-a-rewardandpunishment-audit-of-languagemodel-pricing-agents-6tco}
}More from AI Collusion Research Sprint
- View project: Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence
How can we distinguish genuine coordination between AI agents from coincidental behavioral alignment? We introduce a randomized canary audit that tests whether private information propagates through shared tool state, …
- View project: (1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
(1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
Bid Brother
Can an overseer find two secretly coordinating AI agents just by watching what they do? We tested pairwise net influence (Bonjour et al., 2022) on LLM bidders in a repeated procurement auction, with instructed cartels …
- View project: AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
Fugue
AI agents are starting to negotiate and bid for competing companies. We follow cartels among them from the first proposal to the price the buyer pays, in a sealed-bid procurement market where twelve LLM agents act as …