CanaryNet - agentlessly regulate AI safety
Shahnoor Kiani, Victoria · Team Pi
Submitted to AI Incident Response Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
We created and deployed an architecture that enables external auditors to monitor the containment of misaligned models. CanaryNet is a realistic solution to regulating AI safety across the industry.
Reviews
This is a very cool idea, that the authors explored in depth. I felt the idea was presented as more novel than it is, this is similar to honeypot evals. Also I would've liked to see the idea actually work to catch some interesting behaviour.
CanaryNet offers a good approach to agent auditing by tailoring monitored bait to the task being evaluated. The implementation helps ease-of-use by connecting bait generation, deployment, and trigger logging in a single platform. The report acknowledges that no canary fired in the model runs, so the evidence currently supports deployment feasibility rather than detection effectiveness. The main contribution is the infrastructure for testing this approach, although inconsistent run counts make the evaluation less clear.
Cite this project
@misc{kiani2026canarynet,
title = {{CanaryNet - agentlessly regulate AI safety}},
author = {Shahnoor Kiani and Victoria},
year = {2026},
month = sep,
note = {Submitted to AI Incident Response Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/canarynet-agentlessly-regulate-ai-safety-crah}},
url = {https://apartresearch.com/sprints/projects/canarynet-agentlessly-regulate-ai-safety-crah}
}More from AI Incident Response Sprint
- View project: Adaptive AI-Based Containment of Autonomous Cyber Attacks: A Reproducible Docker Cyber Range Study
Adaptive AI-Based Containment of Autonomous Cyber Attacks: A Reproducible Docker Cyber Range Study
Saarlanders
The study evaluates whether an incident-history-reasoning defender outperforms a fixed response policy against an autonomous LLM attacker changing paths after containment. Using a minimal, isolated Docker cyber range …
- View project: When the Evaluation Is the Incident: Testing AI Incident-Reporting Regimes on the OpenAI–Hugging Face Intrusion
When the Evaluation Is the Incident: Testing AI Incident-Reporting Regimes on the OpenAI–Hugging Face Intrusion
Arathi
AI incident-reporting regimes are being introduced in fast succession to address the concerns that exist in the public sphere and government on the risks associated with frontier AI systems, yet we have limited insight …
- View project: A Recomputable Containment Record for Evaluation Sandboxes
A Recomputable Containment Record for Evaluation Sandboxes
Shadow
In this paper, I address the critical issue of AI agents escaping evaluation sandboxes (as seen in the July 2026 incidents where monitors failed) by proposing an externally audit-able containment layer that doesn't rely …