Capability Requirements and Worst Case Harms for Secret Loyalties
Misbah Tariq · Team Excalibur
Submitted to Secret Loyalties Hackathon. Sprint projects are early-stage work by participants, not Apart Research publications.
Maps Kwon et al.'s activation-breadth/action-breadth space to the concrete capabilities each corner requires (situational awareness, deception, theory of mind, long-horizon planning), then adds a fifth region the taxonomy misses: emergent, zero-attacker loyalty from skewed RLHF feedback. Argues the broad/broad "coup-enabling" corner is the least credible near-term threat given currently demonstrated capabilities, while the narrow/narrow corner, including its emergent variant, is the most likely to already be occupied. Proposes concrete scaling indicators to watch and defensive measures (evaluator-diversity audits, matched-control audits, held-out sign-off panels) targeted specifically at the emergent pathway that existing attacker-centric defenses don't cover.
Reviews
This is a polished and thoughtful capability-based threat analysis, particularly in its distinction between currently demonstrated narrow loyalties and more speculative broad, autonomous variants. The most important revision would be to clarify the status of the proposed “zero-attacker emergent loyalty” pathway. The cited RLHF evidence demonstrates unintended sophistry: greater persuasiveness without greater correctness but does not establish undisclosed preference toward a particular evaluator group or identifiable principal. The argument would be stronger either by treating this as an adjacent alignment failure rather than a secret loyalty, or by providing evidence that skewed feedback produces principal-specific favoritism. The proposed warning indicators should also distinguish proxy capabilities from necessary or sufficient conditions, justify their thresholds, and account explicitly for both likelihood and harm when recommending defensive priorities. A visual capability map and clearer labels separating evidence from speculation would further improve the presentation.
Read full reviewShow less
The mapping is good. It directly answers the track prompts. However the " loyalty" extension is not really a new idea. It is mostly a new name for things that people already know about from RLHF sycophancy findings. To make it better we need to see some examples or experiments. For instance we could do a test to see how people react when the people evaluating them are not very fair. This would make the idea that it's credible in the near term more believable.
The argument for prioritization makes sense. It is still too general. We need to make the recommendations for defense more specific. This means we should say what labs can do tomorrow like what numbers they should look for how they should keep track of things or what they should check for.
Overall this is still work that is clear and answers the question. It is the kind of thing you could do over a weekend. But it does not have any new or interesting ideas or any evidence to back it up so it is not the best it could be. The mapping and the ideas, about " loyalty" and prioritization are good but they need more work to be really great.
Read full reviewShow less
A solid effort. You definitely get points for extending a framework into new domains, but I do not see the case for AI safety here. This reads as a bias paper, and not an AI safety paper. I agree that it is a novel contribution in that it extends the existing framework, but it misses the impact for me. Making the specific threat of this threat model more clear will have helped. The text is written clearly, but feels very AI edited, and could have been significantly shorter or more dense with ideas. A diagram and a summary would have been helpful to clarity the so-what here more.
Cite this project
@misc{tariq2026capability,
title = {{Capability Requirements and Worst Case Harms for Secret Loyalties}},
author = {Misbah Tariq},
year = {2026},
month = jul,
note = {Submitted to Secret Loyalties Hackathon, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/capability-requirements-and-worst-case-harms-for-secret-loyalties-fvta}},
url = {https://apartresearch.com/sprints/projects/capability-requirements-and-worst-case-harms-for-secret-loyalties-fvta}
}More from Secret Loyalties Hackathon
- View project: Identifying the Principal Before Proving the Loyalty: A Two-Stage Audit for Secretly Loyal Language Models
Identifying the Principal Before Proving the Loyalty: A Two-Stage Audit for Secretly Loyal Language Models
To check whether a fine-tuned model has been secretly trained to favour a company, country, political figure or cause, you first have to guess which one, out of an unlimited set. I compare two ways of making that guess …
- View project: Dormancy and Dynamic Range: Detecting Secret Loyalties Without Knowing the Trigger
Dormancy and Dynamic Range: Detecting Secret Loyalties Without Knowing the Trigger
Concealment Defeaters
A secret loyalty has to be quiet off-trigger to stay hidden and loud on-trigger to be useful. Both are measurable without knowing what the trigger is: dormancy (output divergence from the base model on ordinary prompts) …
- View project: Probes Detect the Instruction, Not the Concealment: A Control-Task Audit of Secret Loyalty Probing
Probes Detect the Instruction, Not the Concealment: A Control-Task Audit of Secret Loyalty Probing
Azza
Secret loyalties are installed in models to quietly favour a principal while appearing normal. Lamerton and Roger (2026) found that black-box audits mostly fail on narrow loyalties and suggested that white-box …