Skip to content
Sprint projectSep 14, 2026Paris

Correlating Weak Signals Paged a Synthetic Agentic Intrusion Before Any Secret Was Read

Yassine Bentayfor · Team Signal Before Severity

Submitted to AI Incident Response Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Correlating Weak Signals Paged a Synthetic Agentic Intrusion Before Any Secret Was Read

Code (opens in new tab)
Share

AgentPage is an auditable, sequence aware paging detector for machine speed AI incidents. It correlates distinct suspicious telemetry categories on one host within a sliding window, allowing weak signals to trigger escalation before any single event becomes severe. I compared it with critical only, high severity, and rate only baselines across three canonical synthetic streams and 90 deterministic variants. AgentPage detected all 30 constructed intrusions and paged 106 seconds earlier on average than high severity paging, before secret access in every attack variant. This gain caused six false pages among 60 benign variants. Ablations showed that category deduplication prevents repeated alerts from impersonating independent evidence, while the diversity bonus creates both the earlier warning and its false page cost. The code, data, tests, figures, and results are fully reproducible.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Reviews of strong projects are shared with funders, as you choose below.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Decline to score

Only when the quality of the writing makes the work impossible to follow. Say why in your private critique; nothing shows on this page.

How much would this matter for AI safety if it worked? How innovative is it? For scores of 4-5: is this actually new to the field, or replicating recent work?

Scoring guide
  1. 1Negligible. No clear problem addressed, or no meaningful novelty.
  2. 2Limited. Addresses a real problem but with a generic or well-trodden approach. Incremental at best.
  3. 3Moderate. Clear problem with a reasonable approach; some novelty in framing or method beyond routine application of existing tools.
  4. 4Significant. Important problem with an original approach, or identifies a neglected problem area. A valuable contribution others could build on.
  5. 5Exceptional. Tackles a critical AI safety problem with a genuinely novel approach, or opens a new research direction. Clear theory of change. You'd be excited to share this with researchers in the area.

How sound are methodology, implementation, and findings?

Scoring guide
  1. 1Seriously flawed. Methodology broken, results uninterpretable, or implementation doesn't work.
  2. 2Weak. Approach has significant gaps: missing validation, flawed experimental design, or incomplete implementation.
  3. 3Competent. Technically solid given the short duration. Methodology makes sense, results are interpretable, limitations acknowledged, work builds toward clear conclusions.
  4. 4Strong. Thorough methodology with convincing validation. Results clearly support conclusions. Immediately useful for future work.
  5. 5Exceptional. Ambitious scope executed rigorously. Surprising findings, novel methods, or unusually robust validation.

How clearly are work, findings, and impact potential communicated?

Scoring guide
  1. 1Incomprehensible. Cannot determine what the project is actually claiming or doing.
  2. 2Hard to follow. Key information buried, missing, or diluted by excessive length. Significant effort to extract main points.
  3. 3Clear enough. Can understand the problem, approach, and results without undue effort. Core content clearly present: problem, method, findings, limitations.
  4. 4Well presented. Easy to follow, well-structured, appropriate level of detail. Target audience would get it quickly.
  5. 5Exceptionally clear. A pleasure to read. Complex ideas made accessible. Could serve as a model for how to present this type of work.
Sharing your name *

When we share a strong project with funders, your name, scores and public critique go with it, confidentially; this choice is only about whether your name is public. If you think this project deserves funding, please also endorse it: that carries the most weight.

Share my private critique with funders *

  1. The main gap is positioning. This is risk-based alerting, and Splunk Enterprise Security ships both key mechanisms as default correlation searches — "ATT&CK Tactic Threshold Exceeded" fires on tactic_count >= 3 AND source_count >= 4, which is the diversity bonus, and dc(tactic) is category deduplication. Sentinel, Exabeam, and Chronicle have equivalents. No related work engages with any of it, so a reader from a SOC will see apparent reinvention.

    Both headline metrics are constructed. TPR 1.000 is guaranteed by scenario design; FPR 0.100 is the fraction of benign variants deliberately built to be hard; the 106 seconds depends on where severity labels were placed. The limitations acknowledge the general problem but should connect it to these specific numbers.

  2. The paper tackles the right gap: in the real incident the signals were correlated but nobody was paged. The ablations are honest and they show the diversity bonus causes both the 106-second gain and all six false pages, and that the rate bonus does nothing.

  3. This project presents a clear and auditable feasibility test for an important incident-response question: can correlation of distinct weak signals page a responder before a sensitive action, rather than waiting for one event to become high severity? The strongest result is the explicit operating tradeoff. In the constructed harness, AgentPage detects all 30 attack variants an average of 106 seconds earlier than high-severity paging and before the first secret-access event, but it produces six false pages across 60 benign variants; removing the diversity bonus removes those false pages but also removes the timing advantage. The category-deduplication ablation is also useful, showing that repeated benign inventory signals can otherwise inflate risk as if they were independent evidence. The key limitation is that the detector and all scenario labels, timing distributions, weights, thresholds, and variants were hand-designed by the same author, so the reported 100% TPR and 10% FPR describe this synthetic harness rather than expected production performance. The most important next step is evaluation on independently collected, normalized telemetry with separate tuning and test sets, more realistic class imbalance and alert-volume costs, cross-host correlation, delayed or missing telemetry, and comparisons with additional sequence-aware correlation baselines.

    Read full reviewShow less

Cite this project

@misc{bentayfor2026correlating,
  title = {{Correlating Weak Signals Paged a Synthetic Agentic Intrusion Before Any Secret Was Read}},
  author = {Yassine Bentayfor},
  year = {2026},
  month = sep,
  note = {Submitted to AI Incident Response Sprint, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/correlating-weak-signals-paged-a-synthetic-agentic-intrusion-before-any-secret-was-read-flwi}},
  url = {https://apartresearch.com/sprints/projects/correlating-weak-signals-paged-a-synthetic-agentic-intrusion-before-any-secret-was-read-flwi}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026