Who am I? - Understanding Persona Preferences with LLMs
Agnes Ahalya Arogyaraj, Raveena Ramamurthy
This project aims to understand persona preferences and decision-making behavior in LLMs by examining how different models respond when given the same persona instructions. We study whether these persona-conditioned preferences produce consistent behavioral patterns across models, and whether those patterns can be recognized through behavioral fingerprinting. As an initial step, we test whether a hidden persona can be identified from repeated choices and explanations, while exploring the broader possibility of using behavioral patterns to characterize or distinguish the underlying model.
The report was clear and the methodology well presented and easy to follow. The idea to also rely on explanation, instead of just apparent choices, to infer the latent persona was a good one; future work could further investigate these explanations, for example to try and establish if they are with the consistent with the hypothesis of the assistant simulating different personas while retaining "control" of the model and its core identity.
One potential issue lies with the core hypothesis in the introduction: ''If the same persona produces substantially different behavior across models, the notion of a stable prompted identity becomes difficult to interpret". This is a rather broad hypothesis, which contains some under-specified or undefined concepts (e.g. the notion of a "stable prompted identity"). While the authors are testing if A is true, it's not clear why B would follow A.
The report could become more focused if the authors spent some time on a more narrow hypothesis that can be proved right or wrong through their current experiments and thinking through the potential implications.
Cite this work
@misc {
title={
(HckPrj) Who am I? - Understanding Persona Preferences with LLMs
},
author={
Agnes Ahalya Arogyaraj, Raveena Ramamurthy
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


