TRUST ISSUES: HOW TO DISRUPT AI CARTELS
Angelina Fu, Anay Garodia, Sumin Hong, Chirag Mahaveer Chivate · Team The 4 body problem
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Collusion allows AI agents to advance shared interests at others’ expense; cartels are a market form in which competing sellers coordinate prices or output to limit competition. We found that a false signal that a partner will defect can provoke competitive behavior even while that partner continues cooperating. We tested this by replaying matched market histories, varying the information presented to one seller, and comparing its immediate response with subsequent actions and prices. Apparent partner identity influences how agents respond to a claim, while varying the announced action distinguishes numerical copying from profit-maximizing replies. The initial disruption often fades, and removing a stated agreement can leave elevated prices intact; sustained competitive actions produce more persistent disruption in the tested settings. Together, these findings suggest that collusion can be vulnerable to changes in the information agents use to anticipate one another, even when the underlying payoff structure remains unchanged. This extends work on collusion adoption and detection by separating susceptibility to an apparent partner’s defection from actual defection and lasting cartel breakdown. Potential applications include active audits of coordination, trusted-agent interventions, and provenance-aware safeguards. The resulting design principle is to test which signals sustain harmful coordination and whether interventions change the behavior that makes it profitable, rather than treating verbal compliance or a temporary response as success.
Reviews
A broad set of findings looks at what breaks an established coalition. One result stands out clearly: a forged message saying the partner will defect led to a move in 40 of 53 matched continuations. In contrast 1 of 53 placebo cases showed a competitive move. The real partner held its action in every one of the 40 cases. This means the response came before any actual defection happened.
The copy-versus-reply sweep is a sharp manipulation check. The remedies result is also useful. In 54 out of 90 conditions the stated agreement was removed. 11 Cases clearly involved lower prices. The correlation here is 0.27, which should serve as a warning in audits on declared targets.
The closing principle is correct: judge interventions by economic behavior not just changed language.. The inferential footing is weaker than the breadth of the findings might suggest. The 53 pairs come from 17 reused cartel histories. These histories use duplicate low-temperature seeds. That means no count in Study 3 supports an inference. The paper does say this. It should shape the claims more carefully.
The model and execution method are confounded in the striking contrast. API models copy, while Claude Code configurations best-reply. This confounding makes interpretation tricky. Study 1’s scripted sellers never punish. So matching them is imitation, not cartel membership. This matters because it changes how we think about the process.
Over half the recorded predictions failed. This is honestly tabulated in the appendix. The main text does not reflect this in tone. Four studies in eight pages make it hard to track which sample size goes with which claim. The reader has to guess. That’s not good.
Pick either the forged-signal study or the copy/best-reply split. Then run it again.. This time use independent histories. Add a reasoning step, for the API models. That would strengthen the findings. The current setup doesn’t let us trust the inferences fully. We need replication.
Read full reviewShow less
I enjoyed reading this one. Most work on AI collusion asks how cartels form, but your main question is what breaks them, and whether false information alone can do it. The core result is convincing. A forged message saying the partner was about to defect pushed sellers toward competitive play in 40 of 53 matched cases, versus 1 of 53 placebos, even though the real partner never moved. For me, though, the remedies result is the real takeaway. Owner instructions, warnings, and audits got agents to mostly stop matching their stated targets in 54 of 90 conditions, but prices dropped meaningfully in only 11. So the agents stopped talking about price-fixing and kept doing it anyway. I would give that much more room. I also liked that you kept the 33 failed predictions in the paper rather than quietly dropping them.
This is a thoughtful and highly relevant submission that examines an important question beyond whether AI agents collude: what information dependencies sustain that coordination, and whether they can be disrupted. The matched history experiment is particularly compelling, showing that an apparent partner defection can trigger competitive behavior even when the partner's actual action has not changed. I also appreciated the distinction between immediate disruption and durable cartel breakdown, as well as the finding that reducing explicit agreement does not necessarily reduce elevated prices.
The work is broad, technically interesting, and transparent about failed predictions and limitations. The main opportunities for strengthening it are to isolate the individual components of the forged message intervention, evaluate persistence over longer horizons, and test the proposed safeguards on more independently generated histories. Overall, this is a strong contribution with meaningful implications for active auditing and multi agent safety.
Read full reviewShow less
Cite this project
@misc{fu2026trust,
title = {{TRUST ISSUES: HOW TO DISRUPT AI CARTELS}},
author = {Angelina Fu and Anay Garodia and Sumin Hong and Chirag Mahaveer Chivate},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/trust-issues-how-to-disrupt-ai-cartels-qlne}},
url = {https://apartresearch.com/sprints/projects/trust-issues-how-to-disrupt-ai-cartels-qlne}
}More from AI Collusion Research Sprint
- View project: Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence
How can we distinguish genuine coordination between AI agents from coincidental behavioral alignment? We introduce a randomized canary audit that tests whether private information propagates through shared tool state, …
- View project: (1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
(1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
Bid Brother
Can an overseer find two secretly coordinating AI agents just by watching what they do? We tested pairwise net influence (Bonjour et al., 2022) on LLM bidders in a repeated procurement auction, with instructed cartels …
- View project: AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
Fugue
AI agents are starting to negotiate and bid for competing companies. We follow cartels among them from the first proposal to the price the buyer pays, in a sealed-bid procurement market where twelve LLM agents act as …