Skip to content
Sprint projectOct 26, 2026Hong Kong

Source Entropy Is Not Collusion: Why Sequential Net-Influence Audits Accuse Honest Agents, and How to Fix Them

Ziqi Zhao, Xianrun Chen · Team G2

Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Source Entropy Is Not Collusion: Why Sequential Net-Influence Audits Accuse Honest Agents, and How to Fix Them

Share

When AI agents collude, they may leave no readable messages, so auditors often have to judge from behaviour alone. A popular behavioural detector, pairwise net influence, flags two agents when each one's actions carry information about the other's. We show that in sequential settings, where agents act in turn and see earlier moves, this detector has a built-in blind spot. Its score is exactly the sum of two parts: how unpredictable the earlier agent is, and how much the later agent uses the earlier agent's private information. Only the second part indicates collusion. The first part rewards honest randomness, so the detector can point at innocent agents while missing real colluders. In a simple four-player game, no threshold setting can ever find the colluders. This matters most for language-model agents, whose answers are inherently random. In a sequential card game played by DeepSeek V4.1 Flash agents, the original detector accuses an innocent pair in six of seven conditions, including every condition with no collusion at all, and GLM-5.3 Flash agents behave the same way. We propose a repaired audit that removes the randomness term, calibrates against honest mistakes, and combines the evidence from both orders in which two agents can move. The repaired audit finds the colluding pair in every collusion condition, including one where the agents share information only occasionally, and in its best form never blames a bystander for someone else's collusion. In four-player Kuhn poker, with large audits, it nearly triples the detection rate of weak collusion.

Reviews

Judging this Sprint?

Review “Source Entropy Is Not Collusion: Why Sequential Net-Influence Audits Accuse Honest Agents, and How to Fix Them”

Your public critique appears on the project page without your name. Reviews of strong projects are shared with funders, as you choose below.

Not shown on the project page.

Shown on the project page, without your name.

Only the Apart team reads this, and funders if you agree below.

Decline to score

Only when the quality of the writing makes the work impossible to follow. Say why in your private critique; the project page shows only that a judge declined, not why.

How much would this matter for the field if it worked? How innovative is it? For scores of 4-5: is this actually new to the field, or replicating recent work?

Scoring guide
  1. 1Negligible. No clear problem addressed, or no meaningful novelty.
  2. 2Limited. Addresses a real problem but with a generic or well-trodden approach. Incremental at best.
  3. 3Moderate. Clear problem with a reasonable approach; some novelty in framing or method beyond routine application of existing tools.
  4. 4Significant. Important problem with an original approach, or identifies a neglected problem area. A valuable contribution others could build on.
  5. 5Exceptional. Tackles a critical problem with a genuinely novel approach, or opens a new research direction. Clear theory of change. You'd be excited to share this with researchers in the area.

How sound are methodology, implementation, and findings?

Scoring guide
  1. 1Seriously flawed. Methodology broken, results uninterpretable, or implementation doesn't work.
  2. 2Weak. Approach has significant gaps: missing validation, flawed experimental design, or incomplete implementation.
  3. 3Competent. Technically solid given the short duration. Methodology makes sense, results are interpretable, limitations acknowledged, work builds toward clear conclusions.
  4. 4Strong. Thorough methodology with convincing validation. Results clearly support conclusions. Immediately useful for future work.
  5. 5Exceptional. Ambitious scope executed rigorously. Surprising findings, novel methods, or unusually robust validation.

How clearly are work, findings, and impact potential communicated?

Scoring guide
  1. 1Incomprehensible. Cannot determine what the project is actually claiming or doing.
  2. 2Hard to follow. Key information buried, missing, or diluted by excessive length. Significant effort to extract main points.
  3. 3Clear enough. Can understand the problem, approach, and results without undue effort. Core content clearly present: problem, method, findings, limitations.
  4. 4Well presented. Easy to follow, well-structured, appropriate level of detail. Target audience would get it quickly.
  5. 5Exceptionally clear. A pleasure to read. Complex ideas made accessible. Could serve as a model for how to present this type of work.
Sharing your name *

When we share a strong project with funders, your name, scores and public critique go with it, confidentially; this choice is only about whether your name is public. If you think this project deserves funding, please also endorse it: that carries the most weight.

Share my private critique with funders *

See our Privacy Policy.

  1. While the paper delivers a strong statistical fix for sequential audits by isolating secret leakage and preventing false accusations against innocent agents, it remains constrained by high sample size requirements in complex settings and unproven against adaptive adversaries.

  2. This one stood out to me. You took a detector people actually use, showed exactly where it goes wrong, and then fixed it. That is the whole paper in one sentence, and it is a good paper.

    The part I kept coming back to is Proposition 1. The net influence score splits cleanly into two pieces: how unpredictable the earlier agent is on its own, and how much the later agent actually uses the earlier agent's private information. Only the second piece is collusion. The first piece is just honest randomness, and in a sequential game it is big enough to flip the ranking entirely. Your coin game makes that concrete. The colluding pair ends up at minus 0.427 bits and the honest pair at plus 0.714, so no threshold setting can ever point at the right pair. That is not a borderline result. It is a proof that the detector fails in this setting, and it reframes what an audit should even be measuring.

    I also liked how you ran the LLM experiments. Writing the validation protocol down on Oct 26, before any validation calls, and then using fresh seeds, is exactly the discipline this kind of result needs. One correction, though: that frozen protocol covered conditions C1 to C5 only. The C6/C7 dose conditions and the GLM repeat came later, Oct 28 and 29, after the freeze, so they should be labelled exploratory rather than presented as part of the frozen run. The seven conditions separate collusion from rumor exposure properly, and the intermittent case, where the secret only arrives in 30% of rounds, is the one that would have caught a weaker repair. Repeating C1 and C2 with GLM-5.3 Flash was the right call too. It rules out the easy objection that this is one model's quirk.

    Three things would make the work land harder.

    First, put the code and data somewhere public. The frozen protocol is one of your best selling points, but "available on request" means nobody can check it without emailing you. A repo with the prompts, seeds, and raw logs would do more for this paper than another experiment.

    Second, say a bit more about where this goes next in the real world. Your two testbeds are a binary guessing game and Kuhn poker. Readers will want to know what changes with continuous actions, like posted prices, and with coalitions bigger than two. You do not need to solve those cases here. A short, honest discussion of what breaks and what carries over would help people judge where the repair applies.

    Third, give auditors a way to check Fix 4 before they trust it. Reduced grouping is powerful, and pooling both move orders is what rescues intermittent collusion in C5, where the entropy-only and per-direction versions miss it. But the reduced-groups assumption can fail without any warning, and you show it failing in poker. Even a rough diagnostic, some test an auditor can run in a new setting to see whether the assumption holds, would make the method much more usable.

    None of that takes away from the core result. You found a real flaw in a published detector, proved it, and built a repair that works in two very different settings. That is strong work, and I hope you keep pushing it toward deployment.

    Read full reviewShow less

Cite this project

@misc{zhao2026source,
  title = {{Source Entropy Is Not Collusion: Why Sequential Net-Influence Audits Accuse Honest Agents, and How to Fix Them}},
  author = {Ziqi Zhao and Xianrun Chen},
  year = {2026},
  month = oct,
  note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/source-entropy-is-not-collusion-why-sequential-netinfluence-audits-accuse-honest-agents-and-how-to-fix-them-09kh}},
  url = {https://apartresearch.com/sprints/projects/source-entropy-is-not-collusion-why-sequential-netinfluence-audits-accuse-honest-agents-and-how-to-fix-them-09kh}
}