HuggingThreat: A Community Platform for Secret-Loyalty Artifact Discovery, Adversarial Auditing, and Threat Intelligence
Lihi Shalmon
HuggingThreat is a community-powered intelligence and detection platform for investigating secret loyalties across the open AI ecosystem on Hugging Face—including concealed objectives, allegiances, and behaviors that may evade standard evaluations.
The platform connects model organisms, detection methods, community reports, lineage, and versioned evidence in one shared workflow. Researchers can run or request adversarial assessments, compare results, and build on prior work instead of repeating costly, isolated tests.
To our knowledge, HuggingThreat is the first platform to combine community threat sharing with executable secret-loyalty detection around versioned Hugging Face artifacts.
Thank you for this great submission! Very intrigued by the idea, and absolutely useful for encouraging a shared corpus on research artifacts on AI Safety threats, such as Secret Loyalties. Good shout, too, on the dual-use considerations – I'd love for you to dive further into possible mitigations, e.g. via researcher verification as used in biosecurity. Would be great to put together a screenshot slidedeck or video for your demo to let your prototype shine!
The paper keeps suggesting that a prototype exists, but the link provided is dead. It would have been nice to see a working demo, even if the demo was built on some mock data. These kinds of proposals that are of the shape of "platform that crowdsources info" are easy to propose but a lot of leg work and hustle has to go into execution, and I couldn't find evidence of special insight into what would make such a platform work, or any automated methods that could be deployed on a wide scale.
Cite this work
@misc {
title={
(HckPrj) HuggingThreat: A Community Platform for Secret-Loyalty Artifact Discovery, Adversarial Auditing, and Threat Intelligence
},
author={
Lihi Shalmon
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


