Target Decoupling Does Not Establish Introspection: An Implantation Stress Test for Model Self-Reports
Maksim Pukin
We use subliminal learning to create a model preference with a known causal origin and stress-test several self-report methods. Stricter report tasks remain positive, but origin answers often disagree with ground truth and change with wording, showing that these probes do not by themselves establish introspective access.
Very smart setup. Since you planted the preference you can clearly tell if the model is explaining it with a story that did not happen. Especially since the normally trained control gets it right.
Thoughts :
1. One model, one preference, two training runs seems like a demo not a general finding.
2. The analysis plan not being externally recorded is an important point, a lot rests on it.
3. Appendix B epoch by epoch pattern is interesting, worth exploring more.
It's an interesting and ambitious idea to check whether models can introspect on their training (e.g., how they acquired some preference - through explicit preference training or through some encoded subliminal learning?). However, I'm concerned that this is too difficult a task / an ask of the LLMs (to effectively remember their training process), and will not work.
Cite this work
@misc {
title={
(HckPrj) Target Decoupling Does Not Establish Introspection: An Implantation Stress Test for Model Self-Reports
},
author={
Maksim Pukin
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


