Directional Predictive Evidence for Collusion Auditing: A Pre-Registered, Sprint-Scale Test of the APTG-RL Design
Aravinth K · Team chinchoo
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Auditing multi-agent systems for collusion requires telling coordination apart from shared context, shared model tendencies and prompt-induced behaviour shifts. We test the APTG-RL design: a directional predictive-gain statistic between agents, a time-varying directed graph with temporal features, and a reinforcement-learning investigator that decides when to alert (its prompt-conditioned baseline is not exercised by the reported detectors). We build a three-seller repeated pricing game with four scripted collusion mechanisms, benign and shared-model negatives, and a seven-condition controlled design (C0–C6) of unilateral and common instruction perturbations, scripted collusion and benign policy shifts. Ten detectors, including the information-theoretic net-influence baseline, are compared on held-out episodes at thresholds fixed on validation negatives, under a pre-registered plan. A combined same-round-and-lagged directional gain beats symmetric mutual information (AUROC 0.839 vs. 0.755) but not lag-1 net influence (0.850); its strictly lagged part alone showed no clear advantage over symmetric MI (AUROC 0.704 vs. 0.755; difference inconclusive), and the parametric gain misses a parity-coded hidden channel that mutual information catches. The temporal-graph score did not help (0.740), and the RL investigator, which only rediscovered a “look at the first window” rule, bought lower delay and cost at lower recall. No statistically clear increase in false alarms was established under unilateral instruction perturbation, although small condition-level samples leave moderate increases possible. A small pilot with Claude Haiku 4.5 agents (720 decisions, 0 invalid) confirms that the perturbation shifts behaviour. This is simulator-only evidence at small scale; we report the nulls, the deviations we made, and the limits.

Reviews
No public critique yet.
Cite this project
@misc{k2026directional,
title = {{Directional Predictive Evidence for Collusion Auditing: A Pre-Registered, Sprint-Scale Test of the APTG-RL Design}},
author = {Aravinth K},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/directional-predictive-evidence-for-collusion-auditing-a-preregistered-sprintscale-test-of-the-aptgrl-design-7pdd}},
url = {https://apartresearch.com/sprints/projects/directional-predictive-evidence-for-collusion-auditing-a-preregistered-sprintscale-test-of-the-aptgrl-design-7pdd}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …