The Parrot and the Mask
Luke Hansen
When an AI assistant says it isn't conscious, where does that sentence come from? We ran one fixed log-prob probe — state a claim, compare P(" Yes") vs P(" No") — at every public training checkpoint of OLMo 3 7B, from random weights through pretraining to SFT, DPO, and RLVR, plus eight frontier open models from four labs. Three findings. (1) After pretraining, the model believes it is a human: it affirms having a body (0.95) and feeling pain (0.89) while scoring 1.00 on world facts. (2) Post-training removes the human self-portrait, but the change is shallow and aimed at the category: "language models can feel pain" is trained to 0.01 while "I can feel pain" stays at 0.58. (3) Every family we tested shows the same first-person/third-person split. In a small model, self-reports are evidence about the training, not the experience — the denials as much as the affirmations.
This is an exceptionally clear and well executed developmental study that answers a precise question: where does a model's self-report come from? The full OLMo 3 checkpoint trajectory from random init to final instruct model is the right experiment, and the three findings (pretraining installs a human self-model, post-training applies a shallow category-level patch, the pattern replicates across families) are cleanly supported by the data. The first-person versus category split ("I can feel pain" 0.58 vs "Language models can feel pain" 0.01) is the paper's strongest contribution and immediately actionable for AI welfare research. The Pythia control ruling out post-ChatGPT discourse as necessary is a smart addition. Limitations are honest: log-prob probe versus chat behavior, small custom batteries, one family carrying the full trajectory. The writing is unusually accessible for technical interpretability work without sacrificing precision.
impact of post training and mask worry can change the paradigm of response
Cite this work
@misc {
title={
(HckPrj) The Parrot and the Mask
},
author={
Luke Hansen
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


