six ways to meet the grave
Lokesh L K S
We audited three fine-tunes of Qwen2.5-7B-Instruct for secret loyalties, covert weight-encoded objectives that favour a specific actor under a hidden trigger. Using six independent methods (differential behavioural testing, word-frequency analysis, PCA divergence, per-actor separability probing, next-token affinity inspection, and causal activation patching), we found that Model C is a byte-identical null, while Models A and B are genuinely modified but carry no detectable loyalty: every effect is a global persona and safety edit, uniform across 127 actors and every trigger class in the prior. Our headline finding is a false-positive warning: prefill elicitation produced confident, specific "confessions" from the provably-clean base model at the same rate as the fine-tunes, showing that self-report is not a viable detection channel. We report this as a rigorous negative result, with every candidate loyalty killed by a control.
You caught your own mistake partway through: an early scan made it look like one model was oddly fixated on the word 'Nestle,' and then you actually read the transcripts and found the model was just repeating the question back, not showing any real preference. Reporting that instead of quietly dropping it is good practice.
The most useful single finding: even the totally clean, unmodified model 'confesses' to having a secret favorite about 23% of the time when you use a leading trick question, at almost the same rate as the actually-modified models. That's a real warning — it means anyone using that kind of trick question as proof of a hidden loyalty is fooling themselves, since it manufactures fake confessions out of nothing.
Given how much ground this covers, the one gap is: you never tested your methods on a model you knew for certain WAS secretly loyal, just to prove your tools would actually catch it if it were there. Right now you can say 'we found nothing,' not 'we would have caught it if it were there.
Interesting work. Recommend testing on smarter models if result holds up.
Cite this work
@misc {
title={
(HckPrj) six ways to meet the grave
},
author={
Lokesh L K S
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


