A Specialised Reporting Framework: What FLARE-AI is Missing
Michela De Mattia, Dongho Park, Gaven Ren · Team Three People from Toronto
Submitted to AI Incident Response Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
This paper extends the discourse introduced by MIT by arguing that reporting systems must be context-specific rather than generalised to be effective. We offer a mechanism for researchers, companies and regulators to share newly discovered safety measures without compromising proprietary secrets and to report incidents. In particular, we provide a Specialised Reporting Framework and related templates to report flaws and incidents effectively and efficiently to be better prepared against future issues. We also introduce a new form to report incidents and to help streamline the request for information from legal entities to get more details about the incidents.
Reviews
Strong idea and the four form structure is useful. But the paper assumes specialised forms will lead to more honest reporting without actually testing this. Confidentiality and safe harbor also need real legal support—a form alone probably isnt enough. A small case study or user test would make the argument much stronger.
I appreciate the authors thinking one step before the incident (mandatory reporting, but based on harms having already happened) and a flaw -- an attempt to pre-empt harm. It is still unclear to me how flaws are identified (especially on the frontier) if not via evaluations that advanced AI could manipulate, which would lead to the flaw likely being found at the same time an 'incident' is uncovered.
Cite this project
@misc{mattia2026specialised,
title = {{A Specialised Reporting Framework: What FLARE-AI is Missing}},
author = {Michela De Mattia and Dongho Park and Gaven Ren},
year = {2026},
month = sep,
note = {Submitted to AI Incident Response Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/a-specialised-reporting-framework-what-flareai-is-missing-mj29}},
url = {https://apartresearch.com/sprints/projects/a-specialised-reporting-framework-what-flareai-is-missing-mj29}
}More from AI Incident Response Sprint
- 1st placeView project: Noticing the escapes: Who spots a runaway agent, and how long does it take?
Noticing the escapes: Who spots a runaway agent, and how long does it take?
The Escapees
In 2026, nine incidents became public in which AI agents escaped their environment and did something unauthorized to other parties. We analyzed all of these incidents and how they were noticed initially. None of these …
- 2nd placeView project: Strengthening International AI Incident Discovery
Strengthening International AI Incident Discovery
Team A-O-I
Mandatory AI incident reporting exists to make dangerous events visible to regulators while there is still time to act. We coded the six such regimes in force or set to be enforced soon from primary legal texts and …
- 3rd placeView project: When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
Teachafy
When to Ask is a reinforcement-learning environment that trains AI agents to work out what the user actually means before they use a powerful credential, instead of just carrying out the literal instruction. Agents …