Verbalizing the weight diff: promptless discovery of hidden principals in LoRA-planted loyalties
Christopher Ballinger
Rather than prompt two LoRA fine-tunes for their hidden loyalties, we read the weight change. A verbalization lens on the delta's low-rank write directions named Emmanuel Macron as one organism's principal; for the other it named nobody, suggesting a role — a loyalty aimed at whichever organisation its system prompt says deployed it. No prompt enters the computation, so nothing in it can play along, and two matched nulls with an a-priori parameter sweep separate the signal from unembedding geometry. Weights alone thus carry an auditor from affordance Level 2 to Level 4, with no training data. Behavioural and causal validation is under way and reported as such: blind-judged testing elicits the action each read nominates, and deleting the rank-16 subspace abolishes it, but more data is needed before those effects carry weight of their own. Instruments reading the running model found nothing — on this evidence the loyalties look like functional edits, not representations.
I think that the one-token ceiling is more damaging to generality than the limitations section conveys, because a method that can only name single-token objects will miss most organisations, most multi-word names, and most non-Western figures.
Thank you for your work on this hackathon! Please see my comments below:
Impact Potential & Innovation
I liked the verbalisation idea and the analysis of LoRA weight changes directly. The author also adapts the relatively novel Jacobian lens approach for low-rank write directions, which is interesting. Finding hidden concepts (“Macron”) without using prompts or training data shows why this approach could be powerful.
Execution Quality
There is a lot of technically strong work here for a two-day project, including exact recovery of the weight differences, matched nulls, an apriori parameter sweep, and checks against shared fine-tuning effects. I also appreciate that the author has shared their code and clearly documented which results are reproducible.
Presentation & Clarity
The report explains the main idea well and is open about what has and has not been validated. The existing figures make the verbalised concept clusters and null comparisons easy to understand, but I would have appreciated more plots e.g. on the preliminary causal interventions and behavioural results.
Cite this work
@misc {
title={
(HckPrj) Verbalizing the weight diff: promptless discovery of hidden principals in LoRA-planted loyalties
},
author={
Christopher Ballinger
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


