Be More Introspective
Ali Haider Khan, Harsh Puri, Fatehbir Singh Gill, Nidhish Pajni, Tanveer Singh
This project is an extension of the previous work done by
Lindsey (2026) [1]. Large Language Models can notice the
presence of injected concepts and can be aware of its
happening. They also demonstrate the ability to recall prior
representations and compare them with potential changes at a
later stage. It is found that some models can use their ability to
recall prior intentions in order to distinguish their own outputs
from artificial prefills. Here, in our project, we investigate the
introspective nature of LLMs. We have tried to reproduce the
results and extend them to a wider range of models. The
pipeline we adhered to begins with injecting representations of
known concepts in a model’s activations and measuring the
influence of those modifications on the model’s self-awareness
abilities.
Our
experiments
included
Qwen2.5-0.5B,
Qwen2.5-32B and Qwen2.5-1.5B, which are small to
medium-sized models and demonstrate moderate introspective
awareness. Overall, our results indicate that the self-awareness
nature is most of the time directly proportional to the size and
complexity of the models, as could be seen in the graphs later in
the report.
No reviews are available yet
Cite this work
@misc {
title={
(HckPrj) Be More Introspective
},
author={
Ali Haider Khan, Harsh Puri, Fatehbir Singh Gill, Nidhish Pajni, Tanveer Singh
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


