Correlating Weak Signals Paged a Synthetic Agentic Intrusion Before Any Secret Was Read
Yassine Bentayfor · Team Signal Before Severity
Submitted to AI Incident Response Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
AgentPage is an auditable, sequence aware paging detector for machine speed AI incidents. It correlates distinct suspicious telemetry categories on one host within a sliding window, allowing weak signals to trigger escalation before any single event becomes severe. I compared it with critical only, high severity, and rate only baselines across three canonical synthetic streams and 90 deterministic variants. AgentPage detected all 30 constructed intrusions and paged 106 seconds earlier on average than high severity paging, before secret access in every attack variant. This gain caused six false pages among 60 benign variants. Ablations showed that category deduplication prevents repeated alerts from impersonating independent evidence, while the diversity bonus creates both the earlier warning and its false page cost. The code, data, tests, figures, and results are fully reproducible.

Reviews
The main gap is positioning. This is risk-based alerting, and Splunk Enterprise Security ships both key mechanisms as default correlation searches — "ATT&CK Tactic Threshold Exceeded" fires on tactic_count >= 3 AND source_count >= 4, which is the diversity bonus, and dc(tactic) is category deduplication. Sentinel, Exabeam, and Chronicle have equivalents. No related work engages with any of it, so a reader from a SOC will see apparent reinvention.
Both headline metrics are constructed. TPR 1.000 is guaranteed by scenario design; FPR 0.100 is the fraction of benign variants deliberately built to be hard; the 106 seconds depends on where severity labels were placed. The limitations acknowledge the general problem but should connect it to these specific numbers.
The paper tackles the right gap: in the real incident the signals were correlated but nobody was paged. The ablations are honest and they show the diversity bonus causes both the 106-second gain and all six false pages, and that the rate bonus does nothing.
This project presents a clear and auditable feasibility test for an important incident-response question: can correlation of distinct weak signals page a responder before a sensitive action, rather than waiting for one event to become high severity? The strongest result is the explicit operating tradeoff. In the constructed harness, AgentPage detects all 30 attack variants an average of 106 seconds earlier than high-severity paging and before the first secret-access event, but it produces six false pages across 60 benign variants; removing the diversity bonus removes those false pages but also removes the timing advantage. The category-deduplication ablation is also useful, showing that repeated benign inventory signals can otherwise inflate risk as if they were independent evidence. The key limitation is that the detector and all scenario labels, timing distributions, weights, thresholds, and variants were hand-designed by the same author, so the reported 100% TPR and 10% FPR describe this synthetic harness rather than expected production performance. The most important next step is evaluation on independently collected, normalized telemetry with separate tuning and test sets, more realistic class imbalance and alert-volume costs, cross-host correlation, delayed or missing telemetry, and comparisons with additional sequence-aware correlation baselines.
Read full reviewShow less
Cite this project
@misc{bentayfor2026correlating,
title = {{Correlating Weak Signals Paged a Synthetic Agentic Intrusion Before Any Secret Was Read}},
author = {Yassine Bentayfor},
year = {2026},
month = sep,
note = {Submitted to AI Incident Response Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/correlating-weak-signals-paged-a-synthetic-agentic-intrusion-before-any-secret-was-read-flwi}},
url = {https://apartresearch.com/sprints/projects/correlating-weak-signals-paged-a-synthetic-agentic-intrusion-before-any-secret-was-read-flwi}
}More from AI Incident Response Sprint
- 1st placeView project: Noticing the escapes: Who spots a runaway agent, and how long does it take?
Noticing the escapes: Who spots a runaway agent, and how long does it take?
The Escapees
In 2026, nine incidents became public in which AI agents escaped their environment and did something unauthorized to other parties. We analyzed all of these incidents and how they were noticed initially. None of these …
- 2nd placeView project: Strengthening International AI Incident Discovery
Strengthening International AI Incident Discovery
Team A-O-I
Mandatory AI incident reporting exists to make dangerous events visible to regulators while there is still time to act. We coded the six such regimes in force or set to be enforced soon from primary legal texts and …
- 3rd placeView project: When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
When to Ask: An RL Environment That Teaches AI Agents to Act on What Users Mean and Not Just What They Say
Teachafy
When to Ask is a reinforcement-learning environment that trains AI agents to work out what the user actually means before they use a powerful credential, instead of just carrying out the literal instruction. Agents …