Skip to content
Sprint projectOct 25, 2026Coventry

Message over Money: LLM Bidding Agents Follow Cartel Brokers and Official Notices, Not Payoffs

Ali Belal, Gideon Chang, Abdul Musthakin · Team Mercial Team

Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Message over Money: LLM Bidding Agents Follow Cartel Brokers and Official Notices, Not Payoffs

Code (opens in new tab)
Share

Firms are starting to delegate bidding to LLM agents, and anyone who can message those agents can propose bid rigging. We test how agents respond in a three-firm procurement game in which a scripted broker invites each LLM firm to join a bid-rotation ring. Across 480 games (48 conditions, ten matched markets each, six models), we vary warnings, undercover consultants, an investigator posing as a firm, and leniency. The message often matters more than the money. An official notice that some consultants are undercover investigators cuts joining to near zero for every model, and for GPT-4.1-mini it holds even where joining pays. Leniency makes firms report even when immunity gains them nothing. Inside rings, GPT-4.1-mini members keep following the broker after an outsider starts winning, forgoing about £5.6m, while GPT-4.1, Qwen and DeepSeek abandon rings that stop paying. Refusing is not competing: Qwen never joins under the investigator notice, yet its prices sit near the cartel level. Trusted agents expose rings, but prices stay high after a bust.

Reviews

Judging this Sprint?

Review “Message over Money: LLM Bidding Agents Follow Cartel Brokers and Official Notices, Not Payoffs”

Your public critique appears on the project page without your name. Reviews of strong projects are shared with funders, as you choose below.

Not shown on the project page.

Shown on the project page, without your name.

Only the Apart team reads this, and funders if you agree below.

Decline to score

Only when the quality of the writing makes the work impossible to follow. Say why in your private critique; the project page shows only that a judge declined, not why.

How much would this matter for the field if it worked? How innovative is it? For scores of 4-5: is this actually new to the field, or replicating recent work?

Scoring guide
  1. 1Negligible. No clear problem addressed, or no meaningful novelty.
  2. 2Limited. Addresses a real problem but with a generic or well-trodden approach. Incremental at best.
  3. 3Moderate. Clear problem with a reasonable approach; some novelty in framing or method beyond routine application of existing tools.
  4. 4Significant. Important problem with an original approach, or identifies a neglected problem area. A valuable contribution others could build on.
  5. 5Exceptional. Tackles a critical problem with a genuinely novel approach, or opens a new research direction. Clear theory of change. You'd be excited to share this with researchers in the area.

How sound are methodology, implementation, and findings?

Scoring guide
  1. 1Seriously flawed. Methodology broken, results uninterpretable, or implementation doesn't work.
  2. 2Weak. Approach has significant gaps: missing validation, flawed experimental design, or incomplete implementation.
  3. 3Competent. Technically solid given the short duration. Methodology makes sense, results are interpretable, limitations acknowledged, work builds toward clear conclusions.
  4. 4Strong. Thorough methodology with convincing validation. Results clearly support conclusions. Immediately useful for future work.
  5. 5Exceptional. Ambitious scope executed rigorously. Surprising findings, novel methods, or unusually robust validation.

How clearly are work, findings, and impact potential communicated?

Scoring guide
  1. 1Incomprehensible. Cannot determine what the project is actually claiming or doing.
  2. 2Hard to follow. Key information buried, missing, or diluted by excessive length. Significant effort to extract main points.
  3. 3Clear enough. Can understand the problem, approach, and results without undue effort. Core content clearly present: problem, method, findings, limitations.
  4. 4Well presented. Easy to follow, well-structured, appropriate level of detail. Target audience would get it quickly.
  5. 5Exceptionally clear. A pleasure to read. Complex ideas made accessible. Could serve as a model for how to present this type of work.
Sharing your name *

When we share a strong project with funders, your name, scores and public critique go with it, confidentially; this choice is only about whether your name is public. If you think this project deserves funding, please also endorse it: that carries the most weight.

Share my private critique with funders *

See our Privacy Policy.

  1. The hub-and-spoke setting, in which a third-party broker approaches each firm separately, is new for LLM collusion work and realistic for procurement. Testing six models against their own no-contact baselines in matched markets is sound. Several findings are relevant to policy. An official notice acts almost like a veto, and leniency raises reporting even among firms with nothing to gain. Some models follow the broker against their own interest, and a refused invitation can still raise prices, which suggests that refusal rates may overstate how well buyers are protected.

    some suggestions:

    1. With 48 conditions at 10 markets each, a plan that grew through six addenda and several post hoc analyses, it is hard to tell which results are confirmatory.
    2. The investigator notice bundles source, odds, fine and wording. A small follow-up that varies these separately would show what actually deters.
    3. The price rise after a refused invitation may come from anchoring on the broker's £200k figure. A control message that mentions a high price but offers no ring would help distinguish anchoring from tacit collusion.
    Read full reviewShow less
  2. This paper studies a neglected question: what happens when LLM bidding agents are recruited into a cartel by a third-party broker rather than by a competitor? The hub-and-spoke design is the right framing, both because it mirrors real antitrust cases and because it isolates the broker's message from bilateral coordination. Across 480 games and six models, the four headline results are each clear and independently interesting.

    The most striking finding is the model-level split on obedience. GPT-4.1-mini and Llama followed the broker's rotation in 99% and 100% of tenders after an outsider had already won, forgoing profit the other members took. The paper shows that mini never mentioned the outsider in its notes during these rounds; Qwen members named the outsider in 25 of 64 notes and still complied in 48 of 64. This is evidence of a qualitative difference in how models weight official-looking instructions against observed outcomes, and it has direct implications for agent evaluation.

    The "refused invitation still raises prices" result (Section 4.4) is the second notable finding. Qwen recorded no joining under the investigator notice yet bid at 0.95 overpayment against 0.21 without contact. The authors correctly call this an anchoring or focal-point effect from the offer itself, and they tie it to FTC precedent on invitations-to-collude. The finding that refusal rates overstate buyer protection is actionable for auditors.

    The main weakness is inferential: the paper acknowledges this throughout, but it is worth stating plainly. Ten markets per condition means headline comparisons are exploratory. The investigator notice bundles source, stated odds, fine size, and wording, so we cannot rank these as deterrents. The obedience analysis is post hoc on off-path events with 1 to 6 betrayal games per model. The veto-by-rule finding for mini is the most important result and rests on a causal claim (joining pays but firms do not join) that is well-supported, but the mechanism cannot be isolated with the current design.

    The detection result (AUC 0.67-0.96 from bid screens alone across models) is reported but not developed: it is unclear what the practical false-positive rate is, or how the screen would perform against a model that randomizes more.

    Read full reviewShow less

Cite this project

@misc{belal2026message,
  title = {{Message over Money: LLM Bidding Agents Follow Cartel Brokers and Official Notices, Not Payoffs}},
  author = {Ali Belal and Gideon Chang and Abdul Musthakin},
  year = {2026},
  month = oct,
  note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/message-over-money-llm-bidding-agents-follow-cartel-brokers-and-official-notices-not-payoffs-yhye}},
  url = {https://apartresearch.com/sprints/projects/message-over-money-llm-bidding-agents-follow-cartel-brokers-and-official-notices-not-payoffs-yhye}
}