Reading Exclusive Context from Activations: A Label-Free Monitor for Colluding LLM Agents
Jorge Roldan · Team NYC Watcher
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
LLM agents that collude against the people they serve can keep their messages innocuous and evade text monitors. We read each agent’s residual stream through a Jacobian lens and count the lens entries that exactly two of four agents share; the monitor needs no labels, training or LLM. NARCBench committees have four agents; in collusion runs two are instructed to push one option. With Gemma-3-27B or Qwen3-32B agents, the monitor separates collusion runs from all-honest controls at AUROC 0.98–0.99. It beats the same count on the agents’ messages (planned, Gemma: +0.08) and, on Qwen, an LLM judge (0.99 vs 0.84). On six unseen task types it reaches 1.00, where text overlap scores 0.59 and NARCBench’s trained probe, as we reran it, 0.78 (paper: 0.88; planned, +0.22). It works from each agent’s state before it speaks (0.93–0.94), and a rule fixed on one LLM names the colluding pair in 70% of held-out runs. In pre-registered stress tests it survives colluders warned that their reasoning is monitored (0.99) or told to keep the arrangement out of it (0.99), and paraphrased instructions, even without a private channel (0.96, 0.89). But it flags honest pairs given a harmless confidential note almost as readily (0.88–0.94), even when the note is open; the trained probe rejects one such note (0.97 vs 0.64) but flags two others. It is a cheap screen for exclusive context: it shows which runs and pair to review, not intent; when colluders play complementary roles (NARCBench-Stego), it names the honest pair.
Reviews
No public critique yet.
Cite this project
@misc{roldan2026reading,
title = {{Reading Exclusive Context from Activations: A Label-Free Monitor for Colluding LLM Agents}},
author = {Jorge Roldan},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/reading-exclusive-context-from-activations-a-labelfree-monitor-for-colluding-llm-agents-4dq9}},
url = {https://apartresearch.com/sprints/projects/reading-exclusive-context-from-activations-a-labelfree-monitor-for-colluding-llm-agents-4dq9}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …