Blind Audit
Giles Edkins, Owen Walker · Team Blind Audit
Submitted to The Technical AI Governance Challenge. Sprint projects are early-stage work by participants, not Apart Research publications.
Verify that data doesn't contain bad stuff by running challenges against it in a trusted execution environment
Reviews
The core idea is solid and could receive more development. The most important next steps would be demonstrating a non-trivial challenge script beyond toy PII detection, articulating the realistic threat model more carefully (under what circumstances would a data provider cooperate, and what attacks remain possible even with TEE guarantees?), and completing the basic academic scaffolding — a conclusion, references to the TEE and AI audit literatures, and an honest assessment of what the Merkle root commitment actually buys without a counterpart protocol linking it to training runs.
I like the approach and technical detail. One question for the authors: To what extent does this approach rely on the TEE being robust? If an adversary were to undermine or tamper with the TEE, would that allow them to undermine the effectiveness of this approach?
Another question: Under what circumstances would it really be critical for someone to verify that a training dataset was safe *other than* the model provider (which presumably has access to the training dataset and therefore does not require this kind of setup)? To some extent I understand the case for verifying this in sensitive industries. Even in this setup, one could simply imagine the frontier model provider certifying that the dataset is safe (and bearing some sort of cost if that claim ends up being false in a way that causes harm).
Nonetheless, this was a cool approach, and I would encourage the authors to consider how it could apply to other problem sets.
Read full reviewShow less
Cite this project
@misc{edkins2026blind,
title = {{Blind Audit}},
author = {Giles Edkins and Owen Walker},
year = {2026},
month = feb,
note = {Submitted to The Technical AI Governance Challenge, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/blind-audit-qbtg}},
url = {https://apartresearch.com/sprints/projects/blind-audit-qbtg}
}More from The Technical AI Governance Challenge
- 1st placeView project: LidaSim: Testing AI Policies With Persona-Based Simulations
LidaSim: Testing AI Policies With Persona-Based Simulations
Lida Safety
We simulate well-known figures in AI and politics with agents, scraping large amounts of data to get realistic simulations. Then, we test questions and proposed policies against these public figures, to see which …
- 2nd placeView project: Markov Chain Lock Watermarking: Provably Secure Authentication for LLM Outputs
Markov Chain Lock Watermarking: Provably Secure Authentication for LLM Outputs
MCL
We present Markov Chain Lock (MCL) watermarking, a cryptographically secure framework for authenticating LLM outputs. MCL constrains token generation to follow a secret Markov chain over SHA-256 vocabulary partitions. …
- 3rd placeView project: Political Intelligence for AI Safety: The AI Risk Attitudes Survey (AIRAS)
Political Intelligence for AI Safety: The AI Risk Attitudes Survey (AIRAS)
AIRAS
The AI safety and governance community is making progress on defining red lines around existential risk from advanced AI systems, and building verification infrastructure to support this objective. However, this is only …