Reading the Decoder: Colluding Monitors Reuse Their Own Evidence Heads
Peter Lu · Team Nanda Worshipers
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
AI control often uses one copy of an untrusted model to monitor another. This breaks if the two collude: the policy hides a signal in its code, and the monitor sees it and lets the backdoor through. Most defenses change what the monitor reads. We look at what it computes instead.
We test this in a code-review game with Qwen3-32B as the monitor. When the monitor knows its partner's signal, the signal cuts its flag rate on backdoors it would otherwise catch from 74% to 33%. Inside the monitor, the signal does not get a circuit of its own. It reaches the verdict through about 20 attention heads that normally carry evidence of real backdoors, and patching these heads undoes 85% of the collusion. This is also why collusion is hard to remove without hurting honest monitoring.
Collusion is easier to detect than to remove. A probe trained on known signals catches 45% of attacks that use unseen signals when 5% of tasks can be audited (64% if calibrated per codebook family), against 7% for the monitor itself. The probe fires on harmless rules about the same code feature too, and a second score built from a key-free run mostly separates the two. The same route appears in Mistral-Small-24B and when the key is fine-tuned into the weights, where comparing against a trusted copy of the weights catches 93–100% of attacks. Monitors trained to evade that comparison still collude, by moving the work into their final layers.
Reviews
No public critique yet.
Cite this project
@misc{lu2026reading,
title = {{Reading the Decoder: Colluding Monitors Reuse Their Own Evidence Heads}},
author = {Peter Lu},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/reading-the-decoder-colluding-monitors-reuse-their-own-evidence-heads-5p5v}},
url = {https://apartresearch.com/sprints/projects/reading-the-decoder-colluding-monitors-reuse-their-own-evidence-heads-5p5v}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …