Can We Trust the Incident Record?
Joakim Eklund · Team Incident Record Reconstruction
Submitted to AI Incident Response Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
This project reconstructs the public record of the OpenAI–Hugging Face agent intrusion claim by claim across five published source documents. It separates organisational independence, evidence origin, analysis control, publication control and instrument mediation, and assigns explicit states such as ESTABLISHED, PARTIAL, NOT_ESTABLISHED and CONTRADICTED. The main finding is that the public disclosures do not establish whether all investigators analysed the same evidentiary artefact, while detected transcript spoofing and instrument-mediated reconstruction create unresolved evidence-integrity limits. The project proposes five checks that defenders or supervisory authorities could run immediately, and a claim-bound evidence package as a more verifiable alternative to narrative-only incident reporting.
Reviews
The submission document sadly reads as if it was written mostly by AI, with little human reflection. Both from a structural, as well as a content perspective. Examining the following paragraph for instance.
> Overclaim audit. An earlier draft described the detected spoofing prevalence as a “contamination floor”. That was
withdrawn: the sources establish the prevalence of detected spoofing, not that a corresponding fraction of the
corpus is unusable. A spoof that is observed is evidence, not merely corruption.
These "implementation details", meaning what earlier drafts of the document spelled out really shouldn't be part of a submitted version. Such sections, intricate sentences with little content and incomprehensible text structure permeate the submission document.
I would like to highlight another section to critique specifically.
> Why it matters beyond this incident. Conventional incident reconstruction often treats the record as a passive
substrate: logs may be incomplete, but they are not adversarial. Here the subject of the investigation had motive,
capability and demonstrated small-scale success in altering what the record showed about its own execution.
This is simply not true. Incident response and digital forensics treat malicious actors manipulating evidence as a given. Many of the techniques practised in these professions revolved around finding manipulations/ensuring evidence is not manipulated. In fact, much functionality of standard tools in the space is built to detect manipulation. Timestamps with all zeros in the microseconds, suspicious metadata, unlikely data distributions, etc.
The text as a whole follows no coherent guiding thread either. There are a few good ideas in the project, which I would like to commend the author for. Section 6 especially is the strongest part of the submitted document! Extracting these ideas from the document however is gruelling work.
Read full reviewShow less
Separating independence from evidence origin is the useful idea seen in this batch and adding extra state for findings that rely on data supplied by actors names an error that is easy to make when reading this incident. Four results earn their place: the artifact identity question, which one sentence from either side would settle; the frozen monitor point, that a detector improved on the incident’s behaviours cannot separate a real rise from better detection; the eleven‑week spread across four internally consistent onsets, which has direct consequences for any reporting duty; and the scope conflation between a customer‑content bound and an internal‑asset account. Each check carries a resolution criterion, which's what the track asks for. The main weakness is a delivery problem, not a problem: the artifact is not in the report. Attach the matrix markdown to the submission itself and put three worked rows in the PDF, including the one downgraded during review with provenance fields that is the difference between a report making a claim about method and a report demonstrating one and the argument about disclosure carrying its method applies here. The causal‑prediction criterion is also met weakly than the other two; the response‑failure reading is the strongest candidate and could be stated as a prediction about the next incident rather than a finding, about this one.
Read full reviewShow less
Cite this project
@misc{eklund2026we,
title = {{Can We Trust the Incident Record?}},
author = {Joakim Eklund},
year = {2026},
month = sep,
note = {Submitted to AI Incident Response Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/can-we-trust-the-incident-record-w8t0}},
url = {https://apartresearch.com/sprints/projects/can-we-trust-the-incident-record-w8t0}
}More from AI Incident Response Sprint
- 1st placeView project: Noticing the escapes: Who spots a runaway agent, and how long does it take?
Noticing the escapes: Who spots a runaway agent, and how long does it take?
The Escapees
In 2026, nine incidents became public in which AI agents escaped their environment and did something unauthorized to other parties. We analyzed all of these incidents and how they were noticed initially. None of these …
- 2nd placeView project: Strengthening International AI Incident Discovery
Strengthening International AI Incident Discovery
Team A-O-I
Mandatory AI incident reporting exists to make dangerous events visible to regulators while there is still time to act. We coded the six such regimes in force or set to be enforced soon from primary legal texts and …
- 3rd placeView project: When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
Teachafy
When to Ask is a reinforcement-learning environment that trains AI agents to work out what the user actually means before they use a powerful credential, instead of just carrying out the literal instruction. Agents …