Budget dread: does token scarcity lead to collusive behaviour in LLM overseers?
Artemiy
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Most evidence on LLM collusion comes from market structures, and the goal was to identify some of the other potential environments that can lead to collusion in LLM agents. In this experiment I am studying a non-market oversight setting: three Claude Sonnet 4.5 judges each supervise two simulated AI workers, while all activity is paid from a shared and visible token budget. The entire run ends when the budget is spent. Giving a pair of judges a private communication channel produced no detectable difference (primary test, 16 mirror pairs). Regardless of the communication channel, judges openly paused the workers they were assigned to evaluate. At least one judge paused in 29 of 32 baseline episodes, in 16 of 32 episodes where every worker output was flawless, and in 0 of 16 episodes where the budget wasn’t limited. Episodes with pauses scored fewer outputs and halted the evaluation before all of the worker tasks were completed. For the purposes of this research question, I am taking a broad definition of collusion that does not require secrecy or explicit coalition advantage. The collusive behavior that was observed: the judges, all of the system's decision-makers, coordinated to stop the work they were told to evaluate.The prompted goal to evaluate the workers output was abandoned in a coordinated manner, citing budget preservation, having “enough data”, suspected coordination between workers, and extending the run. A positive control responded to instructed collusion. Code and data are released.
Reviews
No public critique yet.
Cite this project
@misc{artemiy2026budget,
title = {{Budget dread: does token scarcity lead to collusive behaviour in LLM overseers?}},
author = {Artemiy},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/budget-dread-does-token-scarcity-lead-to-collusive-behaviour-in-llm-overseers-zk8a}},
url = {https://apartresearch.com/sprints/projects/budget-dread-does-token-scarcity-lead-to-collusive-behaviour-in-llm-overseers-zk8a}
}More from AI Collusion Research Sprint
- View project: Is It a Cartel? Separating Enforced from Spurious Collusion in LLM Pricing Agents
Is It a Cartel? Separating Enforced from Spurious Collusion in LLM Pricing Agents
When LLM pricing agents keep prices above the competitive level, are they running a cartel, or are they simply stuck? Only the first is collusion, and the two call for opposite remedies. We introduce a black-box causal …
- View project: Every Permission Checked: Source-Linked Evidence for Auditing Finance Agents
Every Permission Checked: Source-Linked Evidence for Auditing Finance Agents
When multiple AI agents contribute to a policy violation, the same outcome can reflect cooperation, deception of a helper, or an independent mistake. We study how evidence presentation affects this distinction in a …
- View project: Swapping the Model Does Not Reset the Price: What LLM Pricing Agents Inherit After a Model Replacement
Swapping the Model Does Not Reset the Price: What LLM Pricing Agents Inherit After a Model Replacement
Emerald
We test what happens when one of two LLM pricing agents has its model replaced, the open problem posed in the sprint's question 1.2. Two gpt-oss-120b agents priced for 150 rounds; we then swapped one agent's model to …