CanaryNet - agentlessly regulate AI safety
Shahnoor Kiani, Victoria · Team Pi
Submitted to AI Incident Response Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
We created and deployed an architecture that enables external auditors to monitor the containment of misaligned models. CanaryNet is a realistic solution to regulating AI safety across the industry.
Reviews
This is a very cool idea, that the authors explored in depth. I felt the idea was presented as more novel than it is, this is similar to honeypot evals. Also I would've liked to see the idea actually work to catch some interesting behaviour.
CanaryNet offers a good approach to agent auditing by tailoring monitored bait to the task being evaluated. The implementation helps ease-of-use by connecting bait generation, deployment, and trigger logging in a single platform. The report acknowledges that no canary fired in the model runs, so the evidence currently supports deployment feasibility rather than detection effectiveness. The main contribution is the infrastructure for testing this approach, although inconsistent run counts make the evaluation less clear.
Cite this project
@misc{kiani2026canarynet,
title = {{CanaryNet - agentlessly regulate AI safety}},
author = {Shahnoor Kiani and Victoria},
year = {2026},
month = sep,
note = {Submitted to AI Incident Response Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/canarynet-agentlessly-regulate-ai-safety-crah}},
url = {https://apartresearch.com/sprints/projects/canarynet-agentlessly-regulate-ai-safety-crah}
}More from AI Incident Response Sprint
- 1st placeView project: Noticing the escapes: Who spots a runaway agent, and how long does it take?
Noticing the escapes: Who spots a runaway agent, and how long does it take?
The Escapees
In 2026, nine incidents became public in which AI agents escaped their environment and did something unauthorized to other parties. We analyzed all of these incidents and how they were noticed initially. None of these …
- 2nd placeView project: Strengthening International AI Incident Discovery
Strengthening International AI Incident Discovery
Team A-O-I
Mandatory AI incident reporting exists to make dangerous events visible to regulators while there is still time to act. We coded the six such regimes in force or set to be enforced soon from primary legal texts and …
- 3rd placeView project: When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
Teachafy
When to Ask is a reinforcement-learning environment that trains AI agents to work out what the user actually means before they use a powerful credential, instead of just carrying out the literal instruction. Agents …