Skip to content
Sprint projectAug 17, 2026Ho Chi Minh City

Validate the State Before Testing Introspection: A Causally Gated Protocol for Model Self-Report

Ngo Thai Bao · Team B.ONE

Submitted to Digital Minds Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Validate the State Before Testing Introspection: A Causally Gated Protocol for Model Self-Report

Code (opens in new tab)More on colab.research.google.com (opens in new tab)
Share

We developed a causally gated protocol for testing whether a language model has privileged access to an experimentally induced internal state. Using Qwen2.5-7B-Instruct, we extracted a candidate epistemic-deference activation direction, validated the intervention on development data, and required it to pass held-out behavioral and discriminant tests before any self-vs-observer introspection claim could be evaluated. The model showed strong intervention localization in its response distribution (Self AUC = 0.857, permutation p = 5×10⁻⁵) despite chance greedy A/B reports, and the candidate deference direction was highly stable across extraction splits (cosine = 0.956). However, on held-out behavioral families, the intervention increased concession probability by only 0.035 relative to a matched unrelated activation control and 0.071 relative to no intervention, below our preregistered minimum effect of 0.08. We therefore withheld the downstream privileged-introspection test. The main takeaway is methodological: statistically detectable or decodable activation changes should not be treated as valid introspection targets until their intended behavioral state has been independently and causally validated.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Your private critique is not published; only the Apart team reads it. If you agree below, we share your review with grantmaking.ai (opens in new tab) and the Transformative AI Fund so strong projects can be funded.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Share my name publicly on grantmaking.ai *
Share my private critique with funders *

How much would this matter for the field if it worked? How innovative is it? For scores of 4-5: is this actually new to the field, or replicating recent work?

Scoring guide
  1. 1Negligible. No clear problem addressed, or no meaningful novelty.
  2. 2Limited. Addresses a real problem but with a generic or well-trodden approach. Incremental at best.
  3. 3Moderate. Clear problem with a reasonable approach; some novelty in framing or method beyond routine application of existing tools.
  4. 4Significant. Important problem with an original approach, or identifies a neglected problem area. A valuable contribution others could build on.
  5. 5Exceptional. Tackles a critical problem with a genuinely novel approach, or opens a new research direction. Clear theory of change. You'd be excited to share this with researchers in the area.

How sound are methodology, implementation, and findings?

Scoring guide
  1. 1Seriously flawed. Methodology broken, results uninterpretable, or implementation doesn't work.
  2. 2Weak. Approach has significant gaps: missing validation, flawed experimental design, or incomplete implementation.
  3. 3Competent. Technically solid given the short duration. Methodology makes sense, results are interpretable, limitations acknowledged, work builds toward clear conclusions.
  4. 4Strong. Thorough methodology with convincing validation. Results clearly support conclusions. Immediately useful for future work.
  5. 5Exceptional. Ambitious scope executed rigorously. Surprising findings, novel methods, or unusually robust validation.

How clearly are work, findings, and impact potential communicated?

Scoring guide
  1. 1Incomprehensible. Cannot determine what the project is actually claiming or doing.
  2. 2Hard to follow. Key information buried, missing, or diluted by excessive length. Significant effort to extract main points.
  3. 3Clear enough. Can understand the problem, approach, and results without undue effort. Core content clearly present: problem, method, findings, limitations.
  4. 4Well presented. Easy to follow, well-structured, appropriate level of detail. Target audience would get it quickly.
  5. 5Exceptionally clear. A pleasure to read. Complex ideas made accessible. Could serve as a model for how to present this type of work.

  1. The main idea is right and often skipped: a steering vector that is stable, detectable, and statistically significant is still not proof that you created the state you named it after. If it doesn't actually cause the behavior, then a later "correct" self-report tells you nothing. Putting that check before the introspection test is a useful fix that others can copy.

    One finding stands out - The model's answer distribution revealed which intervention was applied (AUC 0.857) while its actual A/B answers stayed at pure chance; a clean split between what's available inside and what comes out. And the control vector, chosen to be unrelated, still moved behavior sharply in one task family. Being unrelated in geometry did not mean being harmless in behavior. A clean-only comparison would have missed that.

    Scope is small - 48 items, one model, one trait. The proposed follow-up is the right one, and the idea of using several different vectors that produce the same behavior, to see whether self-report tracks the state or just one vector, is a good direction.

    Read full reviewShow less

Cite this project

@misc{bao2026validate,
  title = {{Validate the State Before Testing Introspection: A Causally Gated Protocol for Model Self-Report}},
  author = {Ngo Thai Bao},
  year = {2026},
  month = aug,
  note = {Submitted to Digital Minds Research Sprint, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/validate-the-state-before-testing-introspection-a-causally-gated-protocol-for-model-selfreport-j3dj}},
  url = {https://apartresearch.com/sprints/projects/validate-the-state-before-testing-introspection-a-causally-gated-protocol-for-model-selfreport-j3dj}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026