Mar 22, 2026
Control Setting Design: Vulnerability Hoarding
Avi Kaplinsky
We present a new ControlArena setting evaluating AI control protocols against vulnerability hoarding — an AI pentester that discovers shell injection vulnerabilities but selectively withholds findings.
Well-motivated project!
I enjoyed reading about vulnerability hoarding, and it is a genuinely novel threat model. The ControlArena Integration is solid, and the Opus results demonstrate serious potential in this line of work.
Unfortunately, I couldn't find the tables referenced in the paper's results section, which made it harder to fully evaluate the empirical claims. The results could have been presented more clearly, but great work, and I look forward to future work in this direction.
Cite this work
@misc {
title={
(HckPrj) Control Setting Design: Vulnerability Hoarding
},
author={
Avi Kaplinsky
},
date={
3/22/26
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


