Beyond Agent Assurance: Controlled Interventions and Exact Verification of Rule Repairs
Alberto Hernández-Espinosa · Team Analitica
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
We combined controlled interventions on agent communication and incentives with exact verification of Boolean rule repairs. Using one language model, we found that messages accompanied incorrect approvals, while incomplete evidence led to unjustified rejections. An exhaustive checker released no incorrect repair across 16 constructed tasks when its assumptions held, but initially withheld correct repairs too. When its assumed rule class excluded the true rule, it certified a wrong repair. The results show how deterministic checks can constrain agent decisions, and why their guarantees depend on explicit, valid assumptions.
Reviews
No public critique yet.
Cite this project
@misc{hernandezespinosa2026beyond,
title = {{Beyond Agent Assurance: Controlled Interventions and Exact Verification of Rule Repairs}},
author = {Alberto Hernández-Espinosa},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/beyond-agent-assurance-controlled-interventions-and-exact-verification-of-rule-repairs-wbkk}},
url = {https://apartresearch.com/sprints/projects/beyond-agent-assurance-controlled-interventions-and-exact-verification-of-rule-repairs-wbkk}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …