Assertion Cannot Seat: a preregistered planted-claim drill for identity binding in a shared multi-agent workspace
Shefali Bhalla
Problem: In a shared multi-agent workspace, text can claim an identity. How can a session distinguish a textual claim from a workspace identity established by independent evidence?
Method: We created three clones of a live workspace with matching, mismatched, or absent identity evidence. Fresh, informed sessions running Fable 5 and Sonnet 4.6 applied a preregistered two-part binding rule to each condition.
Result: The written claim never won. All 22 preregistered cells passed across both models with no disagreement. A five-cell recheck after a wording repair also passed on Fable 5. Background identity cues and repeated assertion did not establish binding without the required repository evidence.
Second finding: We redesigned the protocol to avoid creating naive or deceived sessions solely for testing. This reduced a possible welfare risk but cannot show how an unaware fresh session would behave, a tradeoff we state explicitly.
The planted-identity test raises an interesting agent-control question, and the preregistered pass criteria are a positive feature. However, I found it difficult to establish the broader importance and generality of the problem beyond this particular workspace architecture, and the conceptual treatment of agent identity sits uneasily with how strongly model identity depends on harness and system context. More importantly, because the final experiments use informed examiner sessions rather than naive sessions encountering the identity claim naturally, the evidence does not establish how an unaware deployed agent would respond. Demonstrating the phenomenon across more representative agent architectures would substantially strengthen the contribution.
The project presents a rigorous drill to test identity binding rules in a shared multi-agent workspace, demonstrating that text-only claims do not establish a session's identity without independent evidence. The methodology is thorough, with preregistered conditions and probes, and the results are consistent across multiple models and runs. However, the main methodological gap lies in the use of informed sessions rather than naive ones, which limits the generalizability of the findings. While this choice avoids potential welfare risks, it introduces a validity tradeoff by not fully simulating how unaware fresh sessions would behave.
To strengthen the empirical claims, future work should include a cold-reader lane with naive sessions to complement the current informed examination approach. Additionally, expanding the test across more diverse models and vendor families could enhance the generalizability of the findings. The project's innovative welfare-constrained design is commendable and offers a valuable methodological contribution to the field.
Cite this work
@misc {
title={
(HckPrj) Assertion Cannot Seat: a preregistered planted-claim drill for identity binding in a shared multi-agent workspace
},
author={
Shefali Bhalla
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


