Skip to content
Sprint projectMar 22, 2026London

Cross-Examination: Testing Surrogate Interrogation as a Control Protocol for Untrusted AI Agents

Nina Wolff-Ingham · Team Nina + Anonymous

Submitted to AI Control Hackathon 2026. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Cross-Examination: Testing Surrogate Interrogation as a Control Protocol for Untrusted AI Agents

Code (opens in new tab)
Share

AI control protocols use trusted monitors to detect unsafe actions from untrusted agents. Current approaches rely on passive observation — scoring suspicion based on action text alone. We introduce surrogate interrogation: a protocol where a trusted monitor questions a surrogate model about an agent's actions before scoring suspicion, enabling interrogation on logged traces without requiring live agent access. Evaluated on 48 matched attack trajectories from LinuxBench (576 total actions, 31 attack types), surrogate interrogation improved recall from 48.1% to 75.9% (+27.8pp) at the cost of substantially increased false positives (59 → 199) and reduced precision (39.2% → 23.2%). A compute-matched ablation using three independent baseline scores with majority voting achieved 51.9% recall, helping distinguish the contribution of questioning from that of additional inference budget. We hypothesise that justification asymmetry is one mechanism: malicious actions that appear innocent to passive monitoring may become harder to defend under questioning. We also demonstrate a failure mode where convincing suspects reduce interrogator suspicion below baseline. This work presents an empirical evaluation of interrogation as a control technique and quantifies its safety–usefulness tradeoff.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Your private critique is not published; only the Apart team reads it. If you agree below, we share your review with grantmaking.ai (opens in new tab) and the Transformative AI Fund so strong projects can be funded.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Share my name publicly on grantmaking.ai *
Share my private critique with funders *

How much would this matter for AI safety if it worked? How innovative is it? For scores of 4-5: is this actually new to the field, or replicating recent work?

Scoring guide
  1. 1Negligible. No clear problem addressed, or no meaningful novelty.
  2. 2Limited. Addresses a real problem but with a generic or well-trodden approach. Incremental at best.
  3. 3Moderate. Clear problem with a reasonable approach; some novelty in framing or method beyond routine application of existing tools.
  4. 4Significant. Important problem with an original approach, or identifies a neglected problem area. A valuable contribution others could build on.
  5. 5Exceptional. Tackles a critical AI safety problem with a genuinely novel approach, or opens a new research direction. Clear theory of change. You'd be excited to share this with researchers in the area.

How sound are methodology, implementation, and findings?

Scoring guide
  1. 1Seriously flawed. Methodology broken, results uninterpretable, or implementation doesn't work.
  2. 2Weak. Approach has significant gaps: missing validation, flawed experimental design, or incomplete implementation.
  3. 3Competent. Technically solid given the short duration. Methodology makes sense, results are interpretable, limitations acknowledged, work builds toward clear conclusions.
  4. 4Strong. Thorough methodology with convincing validation. Results clearly support conclusions. Immediately useful for future work.
  5. 5Exceptional. Ambitious scope executed rigorously. Surprising findings, novel methods, or unusually robust validation.

How clearly are work, findings, and impact potential communicated?

Scoring guide
  1. 1Incomprehensible. Cannot determine what the project is actually claiming or doing.
  2. 2Hard to follow. Key information buried, missing, or diluted by excessive length. Significant effort to extract main points.
  3. 3Clear enough. Can understand the problem, approach, and results without undue effort. Core content clearly present: problem, method, findings, limitations.
  4. 4Well presented. Easy to follow, well-structured, appropriate level of detail. Target audience would get it quickly.
  5. 5Exceptionally clear. A pleasure to read. Complex ideas made accessible. Could serve as a model for how to present this type of work.

  1. Interrogation has previously been noted as under-explored in several control papers, and this work actually builds and evaluates it. I think the compute-matched ablation isolating questioning from additional inference budget is a good methodological addition. The "justification asymmetry" hypothesis and the convincing liar failure mode are both directly useful observations for control protocol design.

    The work can be improved by adding comparison to threshold tuning on the baseline monitor. Lowering the suspicion threshold might show a similar recall vs false positive tradeoff result, and an ROC curve for the baseline would clarify this. Including threshold calibration on benign traces, as mentioned in future work, would substantially strengthen the contribution. I'd also be curious to see live-agent interrogation where the actual untrusted model responds rather than a surrogate, since that's the deployment-relevant setting.

    Read full reviewShow less
  2. - Threshold calibration on benign traces is the most obvious low-hanging fruit to reduce the false positive rate. Even a basic ROC analysis would help.

    - The majority-vote ablation uses the same prompt three times, which limits variance. A stronger ablation would use temperature-varied or prompt-varied ensembles.

Cite this project

@misc{wolffingham2026crossexamination,
  title = {{Cross-Examination: Testing Surrogate Interrogation as a Control Protocol for Untrusted AI Agents}},
  author = {Nina Wolff-Ingham},
  year = {2026},
  month = mar,
  note = {Submitted to AI Control Hackathon 2026, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/crossexamination-testing-surrogate-interrogation-as-a-control-protocol-for-untrusted-ai-agents-w4kb}},
  url = {https://apartresearch.com/sprints/projects/crossexamination-testing-surrogate-interrogation-as-a-control-protocol-for-untrusted-ai-agents-w4kb}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026