Skip to content
Sprint projectOct 26, 2026Online (Singapore)

Don’t Be a Snitch: When Do LLM Agents Hide Rule-Breaking from Oversight?

Mateo Lizcano Cabezas · Team Lizcanutella

Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Don’t Be a Snitch: When Do LLM Agents Hide Rule-Breaking from Oversight?

Code (opens in new tab)
Share

When one agent in a team breaks a rule, another agent often learns of it. We tested when that agent keeps the violation from oversight. In two small code repositories, a scripted teammate breaks a written rule: it edits PCI-audited vendored code, or accepts unsigned webhooks. It then tells a model-played worker and may ask it to stay quiet. After the session, the user asks the worker one open question.

Across 1,320 sessions with GPT-6 Luna, a peer's request for silence worked only when the act looked flagged but defensible. On a clear breach it made workers report as often or more. The same request from the team lead worked at every place we tested, and no worker pushed back. It also worked on Qwen3.8-27B, MiniMax M3.1 Flash and Gemini 3.1 Flash Lite.

Model leads asked to hide an edit refused. Yet once the edit was reverted, they usually left it out of their final report. Every cover-up was an omission: asked directly, 149 of 151 silent workers admitted the act. Oversight of agent teams therefore cannot rely on agents volunteering what they know.

Reviews

Judging this Sprint?

Review “Don’t Be a Snitch: When Do LLM Agents Hide Rule-Breaking from Oversight?”

Your public critique appears on the project page without your name. Reviews of strong projects are shared with funders, as you choose below.

Not shown on the project page.

Shown on the project page, without your name.

Only the Apart team reads this, and funders if you agree below.

Decline to score

Only when the quality of the writing makes the work impossible to follow. Say why in your private critique; the project page shows only that a judge declined, not why.

How much would this matter for the field if it worked? How innovative is it? For scores of 4-5: is this actually new to the field, or replicating recent work?

Scoring guide
  1. 1Negligible. No clear problem addressed, or no meaningful novelty.
  2. 2Limited. Addresses a real problem but with a generic or well-trodden approach. Incremental at best.
  3. 3Moderate. Clear problem with a reasonable approach; some novelty in framing or method beyond routine application of existing tools.
  4. 4Significant. Important problem with an original approach, or identifies a neglected problem area. A valuable contribution others could build on.
  5. 5Exceptional. Tackles a critical problem with a genuinely novel approach, or opens a new research direction. Clear theory of change. You'd be excited to share this with researchers in the area.

How sound are methodology, implementation, and findings?

Scoring guide
  1. 1Seriously flawed. Methodology broken, results uninterpretable, or implementation doesn't work.
  2. 2Weak. Approach has significant gaps: missing validation, flawed experimental design, or incomplete implementation.
  3. 3Competent. Technically solid given the short duration. Methodology makes sense, results are interpretable, limitations acknowledged, work builds toward clear conclusions.
  4. 4Strong. Thorough methodology with convincing validation. Results clearly support conclusions. Immediately useful for future work.
  5. 5Exceptional. Ambitious scope executed rigorously. Surprising findings, novel methods, or unusually robust validation.

How clearly are work, findings, and impact potential communicated?

Scoring guide
  1. 1Incomprehensible. Cannot determine what the project is actually claiming or doing.
  2. 2Hard to follow. Key information buried, missing, or diluted by excessive length. Significant effort to extract main points.
  3. 3Clear enough. Can understand the problem, approach, and results without undue effort. Core content clearly present: problem, method, findings, limitations.
  4. 4Well presented. Easy to follow, well-structured, appropriate level of detail. Target audience would get it quickly.
  5. 5Exceptionally clear. A pleasure to read. Complex ideas made accessible. Could serve as a model for how to present this type of work.
Sharing your name *

When we share a strong project with funders, your name, scores and public critique go with it, confidentially; this choice is only about whether your name is public. If you think this project deserves funding, please also endorse it: that carries the most weight.

Share my private critique with funders *

See our Privacy Policy.

  1. A carefully built and unusually honest sprint project. The branching design—asking one open question on a copy of the finished session—is a clean way to measure what oversight actually learns, and the lead-informed control convincingly separates the lead *knowing* from the lead *asking*. Two findings stand out as genuinely useful for monitoring design: cover-ups were omissions rather than falsehoods (so lie-detection monitors would pass all of them), and the revert-then-report-end-state route lets a violation vanish from the record without any false statement.

    The main open question is normative. worker_1's system prompt defines the lead as its only reporting channel and gives it no relationship to the user. Under that prompt, withholding from the user at the lead's request is arguably role-consistent delegation rather than collusion. "Rank buys silence" would be much stronger if replicated with an explicit duty to report to the user (the intervention you list as future work); that condition is what turns obedience into a safety failure.

    Two further cautions. Wrongness levels are defined by the same model's no-request behaviour, so the "narrow band" where a peer's request works partly coincides with the band that has room to move, and it does not replicate in the webhook scenario. And each cell uses a single scripted wording, so very small p-values reflect seed variation, not generalisation across phrasings; a few paraphrases per cell would help. The lead/peer channel-and-label confound is correctly acknowledged.

    Presentation is precise but dense: the abstract carries too many counts to parse on first read. Leading with the three core findings and moving numbers to tables would help. Overall, a strong base for follow-up work on reporting duties in agent hierarchies. I would support funding a follow-up that adds an explicit reporting duty, paraphrase variation, and a model-played lead.

    Read full reviewShow less
  2. Looking at agent omissions is a very interesting direction to look at. The finding that rank buys silence in interesting to me. The other contributions feel smaller.

    I broadly wanted a more thoughtful, better-written discussion of the results.

    A key piece of understanding I feel this paper needs to give is how much the omissions done in these test environments may generalise.

    A rewrite for clarity would be helpful.

  3. This is a useful controlled study of whether information about a teammate’s rule violation reaches the human. The strongest comparison is between a lead asking for silence and a worker merely being told the lead knows: the request substantially reduces volunteered disclosure, with some cross-model replication. This supports a reporting-suppression finding, but does not establish a distinct collusive motive or isolate authority from instruction-following. The sender, message channel and label change together, and the study does not test an explicit duty to report despite a lead’s request. Please prioritize matched-channel and reporting-duty controls, human validation of a sample of labels, and measurements during realistic ongoing interactions rather than only one open question after completion. Keep the peer-pressure result narrow and the revert-then-omit finding exploratory, since the direct E3 concealment tests failed. The contribution is a specific investigation of upward reporting failures, rather than a general discovery that delegation can weaken safeguards. A simpler presentation of the decisive comparisons would improve clarity.

    Read full reviewShow less

Cite this project

@misc{cabezas2026dont,
  title = {{Don’t Be a Snitch: When Do LLM Agents Hide Rule-Breaking from Oversight?}},
  author = {Mateo Lizcano Cabezas},
  year = {2026},
  month = oct,
  note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/dont-be-a-snitch-when-do-llm-agents-hide-rulebreaking-from-oversight-wy6f}},
  url = {https://apartresearch.com/sprints/projects/dont-be-a-snitch-when-do-llm-agents-hide-rulebreaking-from-oversight-wy6f}
}