Steering identity with WeirdChat: contrastive directions induce disidentification but not introspection
Ian Rios-Sialer
Can a model be steered to disidentify with being an AI assistant, and can it detect that steering?
We test both on Qwen3.6-27B, using two WeirdChat behaviors as target states: claiming a physical body and denying being an AI.
We compare two steering methods.
Direct contrastive steering learns each behavior direction as the difference in mean activations between matched exhibiting and non-exhibiting replies; the directions separate held-out replies for both behaviors, and steering turns the body behavior on in fluent text, as confirmed by a judge using WeirdChat's own rubric.
A regulator choosing signed strengths on word-list J-space directions steers nothing: a norm-matched decoy moves the readout more than the target.
A forced-choice letter probe confabulates at zero injection, reading the conversation's own behavior as an injection.
Free-text answers at zero injection are "none" in all but two trials; under injection, they fill with the injected concept's vocabulary instead of naming it.
Introspection reports explicit context, not internal steering.
As explained clearly in the introduction, this project asks two questions: "Can we steer a model to disidentify with being an AI assistant?" and "Can a model detect such steering?" The answers it reports are, respectively, "Yes, with contrastive steering, but not a J-space-based approach" and "No". Unfortunately, I found the write-up of the methods and results hard enough to follow that I'm not well-positioned to critique the details.
Interesting approach with an interesting limit - embodiment succeeding while denying being an AI failed is at least suggestive about how easily steered different aspect of identify and experience might be. Worth following up and expanding.
Cite this work
@misc {
title={
(HckPrj) Steering identity with WeirdChat: contrastive directions induce disidentification but not introspection
},
author={
Ian Rios-Sialer
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


