Who Prefers What? Identity-Selective Causal Encoding of Stated and Revealed Preferences in a Language Model
Jessica Cruz
Language models can express different preferences under different identities, but behavior alone cannot show whether internal representations track who prefers what. We causally intervened on contextual representations in Gemma-2-2B-IT, comparing explicitly stated preferences with preferences inferred from stable choices. A carrier validated on stated preferences transferred without retuning to revealed choices on 64 fresh confirmatory worlds, with all pair-level effects positive. Our results support an identity-selective causal encoding signature for stated and behaviorally revealed binary preferences.
This project is well scoped & carefully executed. It answers a genuinely upstream question: does a language model correctly keep track of who wants what? The methodology used to isolate attribution cleanly with counterfactual ownership swapping is clean & the discipline followed around it is clearly visible in the codebase - freezing the protocol, hashing the dataset, running stages ensuring no peeking, logging the failed approaches is on point.
This project's new finding is that the same carrier works whether the preference is stated ("K prefers X") or only revealed through repeated choices. The stated-vs-revealed transfer is the contribution.
Two suggestions. First, foreground the embedding-layer control. Because the patched token is required to be identical in both versions, an embedding-level patch should do nothing, so any effect at layer 5 has to come from contextualized state rather than a word swap. The code makes this point; the paper mostly leaves it implicit, and it's the strongest answer to the obvious "isn't this just swapping the word?". Second, the limits named are the right ones: one small model, synthetic worlds, placeholder identities, two choices. The 2×2 factorial proposal, check on a real relational-binding baseline and replication on other models feels like a natural direction. All the best for future developments!
Cite this work
@misc {
title={
(HckPrj) Who Prefers What? Identity-Selective Causal Encoding of Stated and Revealed Preferences in a Language Model
},
author={
Jessica Cruz
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


