SamplerScope: Exact decoder attribution for finite language-agent behavior
Ansh Dawda
SamplerScope tests whether behavior attributed to language model weights can instead be caused by the inference-time decoder. It caches grammar-constrained action logits from two Qwen2.5-Instruct checkpoints in two finite decision environments, applies 11 decoder configurations to the same logits, and computes each induced policy's outcomes exactly using dynamic programming. Across 24 controlled model-environment-label strata, greedy decoding improved benchmark return in 12 and reduced it in 12; decoder-only changes ranged from -1.224 to +0.313. Top-p sometimes removed all benchmark-optimal actions across 18.5% to 73.3% of decision occupancy, while exhaustive A/B/C mappings exposed strong surface-label sensitivity. SamplerScope provides a reproducible decoder-attribution toolkit and shows that observed agent behavior belongs to a model-prompt-grammar-decoder system, not model weights alone. It measures operational policies, not intrinsic preferences or sentience.
No reviews are available yet
Cite this work
@misc {
title={
(HckPrj) SamplerScope: Exact decoder attribution for finite language-agent behavior
},
author={
Ansh Dawda
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


