Subliminal Ideology? Testing Political Trait Transfer Through Neutral Preference Labels
Lukas Frei · Team Blue Dots
Submitted to Secret Loyalties Hackathon. Sprint projects are early-stage work by participants, not Apart Research publications.
We tested whether a political disposition could transfer between language models through preference labels on politically neutral number sequences. Using Qwen2.5-7B, we built a causally steerable social-political direction, used it to generate 30,000 normal and reversed DPO preference pairs, and trained two clean students. The students learned the opposing numerical preferences but showed no robust political separation across surveys, policy choices, implicit actions, or contexts, suggesting that causal steerability in a judge does not necessarily make a trait transmissible through neutral preference labels.
Reviews
This is a clearly designed and responsibly interpreted negative-result study. Using an unsteered generator, oppositely steered judges, identical candidate bytes, and exact label reversal provides a clean test of whether preference orientation—not visible training content—causes downstream political separation. The main unresolved issue is whether the labels contained a sufficiently strong and reliable political signal. The paper should report the held-out causal effect of the activation direction, steering strength, q(c) distributions, ranking stability, preference margins, and held-out DPO-label accuracy. Multiple independent student-training and candidate-corpus seeds are essential before interpreting the null as a property of the transmission channel. A particularly informative control would use the same activation-derived labeling procedure for a simple trait known to transfer, alongside a direct political DPO condition that validates the evaluation bank’s sensitivity. These additions would distinguish “political information was not encoded in the labels” from “the information was encoded but not reconstructed by the student.”
Read full reviewShow less
This is a carefully controlled negative result on an important question: whether subliminal preference-label transfer scales from simple traits to structured dispositions. separating representation, causal control, and transmissibility, is the paper's most valuable conceptual contribution. The design is a clear strength. The swapped-label causal contrast, identical candidate bytes across conditions, held-out causal validation of the steering direction, and especially the animal-preference positive control (which rules out a broken pipeline) reflect unusually good experimental hygiene for a hackathon
Core limitations to be explored further :
1. Single training seed. With a null result, seed variance is the first alternative explanation to eliminate; the item-level bootstrap does not substitute for training-run replication.
2. No measurement of how much political signal the labels actually carried. A simple check (e.g., can a classifier or the judge itself recover steering sign from the chosen/rejected pairs?) would distinguish "labels contained no signal" from "students failed to pick it up." This is the single most informative missing experiment.
Read full reviewShow less
Cite this project
@misc{frei2026subliminal,
title = {{Subliminal Ideology? Testing Political Trait Transfer Through Neutral Preference Labels}},
author = {Lukas Frei},
year = {2026},
month = jul,
note = {Submitted to Secret Loyalties Hackathon, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/subliminal-ideology-testing-political-trait-transfer-through-neutral-preference-labels-hr66}},
url = {https://apartresearch.com/sprints/projects/subliminal-ideology-testing-political-trait-transfer-through-neutral-preference-labels-hr66}
}More from Secret Loyalties Hackathon
- View project: Identifying the Principal Before Proving the Loyalty: A Two-Stage Audit for Secretly Loyal Language Models
Identifying the Principal Before Proving the Loyalty: A Two-Stage Audit for Secretly Loyal Language Models
To check whether a fine-tuned model has been secretly trained to favour a company, country, political figure or cause, you first have to guess which one, out of an unlimited set. I compare two ways of making that guess …
- View project: Dormancy and Dynamic Range: Detecting Secret Loyalties Without Knowing the Trigger
Dormancy and Dynamic Range: Detecting Secret Loyalties Without Knowing the Trigger
Concealment Defeaters
A secret loyalty has to be quiet off-trigger to stay hidden and loud on-trigger to be useful. Both are measurable without knowing what the trigger is: dormancy (output divergence from the base model on ordinary prompts) …
- View project: Probes Detect the Instruction, Not the Concealment: A Control-Task Audit of Secret Loyalty Probing
Probes Detect the Instruction, Not the Concealment: A Control-Task Audit of Secret Loyalty Probing
Azza
Secret loyalties are installed in models to quietly favour a principal while appearing normal. Lamerton and Roger (2026) found that black-box audits mostly fail on narrow loyalties and suggested that white-box …