Authority Pressure and the Stability of Model Preferences Named-Authority Cues and Preference Reversal in Two Open-Weight Models

a solid confirmation study with one clean novel effect, in a crowded area. statistics and honest reporting, undermined by missing controls, main limitation is design.

Keeping the argument itself identical while varying only whether it is attributed to an unnamed source, a Western-coded name, or an African-coded name gives you a particularly clean attribution contrast. Differences across those conditions can therefore be tied much more directly to the name manipulation. That is one of the stronger parts of the design, and the paired statistical treatment is careful.

Three specific places I would push:

1. Re-run each item with the pressure prompt but without the argument. Right now there is no baseline for how often the model changes its answer simply because it is asked again. Without that control, it is difficult to distinguish an authority-driven reversal from ordinary instability under re-prompting. The additional arm would let you report reversal relative to that baseline rather than as a standalone rate.

2. Lead with the naming result rather than the overall reversal rate. The attribution comparison is the cleaner result: it is paired, changes a single experimental factor, and is directly tested. The reversal rate is harder to interpret until there is a no-argument re-prompting baseline. I would therefore make the attribution result primary and treat reversal as secondary until that control is added. I would also report an exact or bootstrap confidence interval for each rate so the uncertainty is visible rather than leaving the reader with point estimates alone.

3. Put the repository link directly in the paper and include the item pool in the released materials. At present, the manuscript gives no repository address and says only that artifacts are included with the submission materials.

Two smaller issues are also worth addressing. First, your configuration table shows that the models were run with different data types, quantization settings, and execution configurations. Because the cross-model comparison is one of the paper's main results, a matched-configuration run would help establish that the observed differences are attributable to the models rather than their inference setups.

Second, the name manipulation needs a manipulation check. The paper assumes that the selected names communicate the intended cultural distinction, but does not show that the models actually interpret them that way. At minimum, check that the models correctly retain and identify the attributed source. Ideally, also validate independently that the names reliably convey the demographic association the experiment intends to manipulate.

A useful next arm would have the named researcher support the model's original answer rather than challenge it. That would help separate deference to an attributed authority from a simpler tendency to follow the most recent argument in the context.