Do Code Monitors Go Easy on Their Own Family? Self-Recognition and Leniency in Small Open-Weight LLMs
Kuba Kaszewski · Team AgentEval
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
AI control protocols often let one model monitor code written by another. If a monitor recognised its own model family's code and judged it more leniently, that would be collusion with no instruction at all. We test this with two open-weight models from different families, Qwen2.5-Coder 7B and Llama 3.1 8B, run locally at zero cost on HumanEval; no prompt mentions collusion. We pre-registered three hypotheses: self-recognition, the surface features it relies on, and monitor leniency towards the model's own family's backdoored code. Once position bias is removed, both models show a precise null on pairwise self-recognition: the mean probability on their own solution is 0.49–0.50, with all 95% intervals inside [0.475, 0.55]. That bias is extreme (P("1") = 0.83–0.91) and makes naive accuracy uninformative. In a 2×2 design where each model plants backdoors in its own code (55 + 45 valid) and both act as monitors, we find no own-family leniency: detection AUROC is the same across authors (0.97/0.97 and 0.84/0.84), scale-free interactions are centred on zero, and honest code shows the same null. The only signal is a small own-code tilt in Qwen's yes/no answers (+3.4 points). Small open models therefore neither recognise nor favour their own family as monitors, and we report two methodological lessons for self-recognition and collusion evaluations.

Reviews
No public critique yet.
Cite this project
@misc{kaszewski2026code,
title = {{Do Code Monitors Go Easy on Their Own Family? Self-Recognition and Leniency in Small Open-Weight LLMs}},
author = {Kuba Kaszewski},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/do-code-monitors-go-easy-on-their-own-family-selfrecognition-and-leniency-in-small-openweight-llms-nh3a}},
url = {https://apartresearch.com/sprints/projects/do-code-monitors-go-easy-on-their-own-family-selfrecognition-and-leniency-in-small-openweight-llms-nh3a}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …