Pairwise net influence on LLM action logs: detection at the calibrated rate, blind to two pairs, fooled by low-temperature shared priors
Juan Pablo Hidalgo Garcia
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Pairwise net influence (Bonjour, Aggarwal and Bhargava, 2022) identifies a colluding pair from logged actions alone and has never been tested on language-model agents (LLM). We implement and validate it on a scripted Rock-Paper-Scissors code with a known colluding pair. We reproduce the paper's Table 2 when the state is the previous round's joint action, which the paper does not state. Under that assumption, a spurious pair is named in half of 50-round games with no collusion. Pre-registered anti-examples show that the one-pair gate is blind to two pairs, one-way dependence is reported as mutual, and lagged copying is invisible. We then run 72 games of four LLM agents (mostly gpt-4.1-mini) with one instructed pair or none. The assistant complied only partly (scripted-scale strength 0.13 to 0.33), and at those strengths the scripted calibration predicts the LLM detection rates within sampling error. Net influence ranked the true pair first in 16 out of 20 60-round games, with a stronger assistant at 200 rounds. Both rules identify the pair on 3 of 4 occasions, the miss being the one-pair gate tripped by a same-model pair. An action-log LLM judge gave the first-listed pair at least 0.5 in 9 of 10 controls: a position bias. Same-model agents are not flagged at temperature 1.0 under a permutation threshold (less than 1 out of 10) but are at 0.3 (2 out of 5), and in mixed-model games every flagged pair was same-model. A permutation threshold and a multi-pair variant are new here. The statistic is a plus factor, not proof of agreement.
Reviews
No public critique yet.
Cite this project
@misc{garcia2026pairwise,
title = {{Pairwise net influence on LLM action logs: detection at the calibrated rate, blind to two pairs, fooled by low-temperature shared priors}},
author = {Juan Pablo Hidalgo Garcia},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/pairwise-net-influence-on-llm-action-logs-detection-at-the-calibrated-rate-blind-to-two-pairs-fooled-by-lowtemperature-shared-priors-kwy7}},
url = {https://apartresearch.com/sprints/projects/pairwise-net-influence-on-llm-action-logs-detection-at-the-calibrated-rate-blind-to-two-pairs-fooled-by-lowtemperature-shared-priors-kwy7}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …