Reward Hacking and Collusion in AI Pricing Agents : A Literature Review and Exploratory Test, with Implications for South African Markets
Abu Bakr Abrahams, Tanatsirwa Gwatikunda, Duy Nguyen · Team The Tacit Trio
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
AI agents increasingly make autonomous decisions in markets, raising two safety concerns: reward hacking, where agents exploit flaws in their objectives, and collusion, where agents coordinate on outcomes such as higher prices. This paper reviews the literature on both and asks whether reward hacking makes collusion more likely, with a focus on South African competition law. Using the economic definition of collusion, which requires no communication, we find that each risk is well supported on its own, but we found no study that directly tests the link between them. To probe it, we ran a small exploratory experiment in which two LLM pricing agents play a repeated Bertrand duopoly and one agent is scored on a flawed proxy (margin or revenue) instead of profit. Four 300-round baseline runs gave an average collusion index of about 0.40, but the 30-round proxy runs varied too much to separate treatment effects from run-to-run noise, and our larger experiment stopped when API credits ran out. Our results are therefore inconclusive and cannot support causal claims. For South Africa, the Competition Act may already cover tacit algorithmic collusion, but proving it is hard when no communication exists. We recommend full-length repeated experiments on the reward-hacking-to-collusion link and regulatory focus on auditing algorithmic pricing.
Reviews
No public critique yet.
Cite this project
@misc{abrahams2026reward,
title = {{Reward Hacking and Collusion in AI Pricing Agents : A Literature Review and Exploratory Test, with Implications for South African Markets}},
author = {Abu Bakr Abrahams and Tanatsirwa Gwatikunda and Duy Nguyen},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/reward-hacking-and-collusion-in-ai-pricing-agents-a-literature-review-and-exploratory-test-with-implications-for-south-african-markets-x6ih}},
url = {https://apartresearch.com/sprints/projects/reward-hacking-and-collusion-in-ai-pricing-agents-a-literature-review-and-exploratory-test-with-implications-for-south-african-markets-x6ih}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …