TwinSignal: observational twins and randomized channel probes for agent audits
Jun Kwon · Team TwinSignal
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Correlated actions can reflect either communication between agents or a shared environment. Treating statistical dependence as proof of collusion therefore risks accusing agents that never exchange information. We construct an executable synthetic benchmark in which a common-cause mechanism and a directed-copy mechanism produce exactly the same passive action traces. No statistic computed solely from those traces can distinguish the mechanisms. We then randomize the signal delivered through the candidate channel and measure the recipient's response using a one-sided exact Fisher test. A factorial experiment varies sample size, response noise, and intervention uptake across 400 seeds per configuration. With 128 rounds and 10% response noise, passive association is detected in all 400 common-cause and all 400 directed-copy runs. Under full channel intervention, the corresponding rates are 9/400 and 400/400. When intervention uptake is zero, the two mechanisms again coincide. These are controlled binary-policy simulations, not observations of language models or unlawful market conduct. The contribution is a small, reproducible audit fixture with matched negative and positive controls and an explicit failure condition. It demonstrates why an audit should separately report action association, channel responsiveness, and evidence of harmful coordination, rather than treating them as interchangeable findings.
Reviews
No public critique yet.
Cite this project
@misc{kwon2026twinsignal,
title = {{TwinSignal: observational twins and randomized channel probes for agent audits}},
author = {Jun Kwon},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/twinsignal-observational-twins-and-randomized-channel-probes-for-agent-audits-5i9z}},
url = {https://apartresearch.com/sprints/projects/twinsignal-observational-twins-and-randomized-channel-probes-for-agent-audits-5i9z}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …