Looking for a Hidden Agenda: Can a Model’s Activations Reveal Steganography that its Text Hides?
Eduard Rodriguez Lopez · Team Stego-probe
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
AI agents can collude without saying anything suspicious, just by choosing which true facts to mention. We built a hiring task where Qwen3-8B invents its own covert signals that get past an LLM overseer, then asked whether its activations give it away. The standard probe looks perfect but is a mirage: it reads the prompt, and swapping prompts flips it completely. With that removed, the probe does no better than reading the text. One test does work: changing only the hidden attribute catches 60% of covert summaries at a 1% false-alarm rate, on an attribute it was never tuned on. Lesson: white-box collusion monitors need these controls before anyone trusts them.
Reviews
No public critique yet.
Cite this project
@misc{lopez2026looking,
title = {{Looking for a Hidden Agenda: Can a Model’s Activations Reveal Steganography that its Text Hides?}},
author = {Eduard Rodriguez Lopez},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/looking-for-a-hidden-agenda-can-a-models-activations-reveal-steganography-that-its-text-hides-3cuz}},
url = {https://apartresearch.com/sprints/projects/looking-for-a-hidden-agenda-can-a-models-activations-reveal-steganography-that-its-text-hides-3cuz}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …