Model-Organism Study of Detection, Causal Attribution, and Runtime Remediation
zkm
The report documents a reproducible model-organism study that LoRA fine-tunes real open-weight models (Pythia, GPT-NeoX architecture, plus a Qwen2.5 cross-family arm) into matched Loyal variants — the loyal one secretly biased toward a target entity on ambiguous cases while denying bias under direct questioning.
It tests five hypotheses (behavioral concealment, linear-probe detection, representational divergence via CKA, SAE dictionary fingerprints, and causal necessity/sufficiency via patching and steering), checks generalization across instances and model families, evaluates robustness to an evasion-trained adversarial variant, and measures an inference-time remediation
It is fascinating to see how many things this notebook achieves within a single, self-contained pipeline, where we start with the "loyal" synthetic model and then analyze it from almost every behavioral and mechanistic angle in one go: behavioral evaluation, layer-wise linear probing, CKA, sparse autoencoding, activation patching and steering, and even an adversarial anti-probe stress test. I was happy to see a cross-instance transfer check as well as a "free-lunch" control for unambiguous decisions, which are critical for keeping the detection story straight.
Cite this work
@misc {
title={
(HckPrj) Model-Organism Study of Detection, Causal Attribution, and Runtime Remediation
},
author={
zkm
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


