Skip to content
Sprint projectJun 21, 2026Cuttack

TraceGuard-X: Adaptive Collusion Resistant Monitoring for Agentic AI Systems, a hierarchical governance framework with constitutional dimension prompting…

AYUSH KUMAR SAMAL · Team AdAstra

Submitted to Global South AI Safety Hackathon. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: TraceGuard-X: Adaptive Collusion Resistant Monitoring for Agentic AI Systems, a hierarchical governance framework with constitutional dimension prompting…

Code (opens in new tab)
Share

The deployment of increasingly capable autonomous AI agents raises a fundamental governance challenge: how can a monitoring system reliably distinguish benign from harmful behaviour when both the acting agent and the monitor may be strategically misaligned? Recent work on TraceGuard introduced structured multi-dimensional monitoring as a collusion-resistant alternative to single-score evaluation. While promising, three key questions remain unresolved: (i) robustness against rubric-aware adaptive attackers, (ii) computational efficiency of multidimensional monitoring, and (iii) generalisation beyond shell-based environments. We present TraceGuard-X, a hierarchical monitoring framework that extends TraceGuard through adaptive adversarial evaluation, dynamic dimension routing, temporal trajectory analysis, federated monitoring, and cross-environment governance transfer. TraceGuard-X introduces six core mechanisms: Constitutional Dimension Prompting (CDP), Temporal Graph of-Thought Monitoring (TGM), Divergence-Based Collusion Detection (DBCD),Dynamic Relevance Routing (DR-TraceGuard), Multi-Model Federated Monitoring (MMFM), and Hierarchical Domain-Adaptive Governance Transfer (HiDAgT). Preliminary calibration experiments on the BashArena benchmark demonstrate statistically significant separation between benign and attack trajectories across all five monitoring dimensions, with large effect sizes (Cohen’s d > 0.96 on every dimension) and highly significant Kolmogorov-Smirnov statistics (p < 10−5 across all dimensions). A three-dimension routing policy achieves 84% of full-ensemble AUC at 60% API cost. The three-layer HiDAgT architecture enables zero-shot transfer to Infrastructure-as-Code, code-generation, and web-agent environments without modifying the universal meta-monitor. Our results suggest that structured monitoring remains a viable governance primitive even under increasingly sophisticated attack models and heterogeneous deployment environments. All code, calibration data, and evaluation infrastructure are publicly available.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Your private critique is not published; only the Apart team reads it. If you agree below, we share your review with grantmaking.ai (opens in new tab) and the Transformative AI Fund so strong projects can be funded.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Share my name publicly on grantmaking.ai *
Share my private critique with funders *

How much would this matter for AI safety if it worked? How innovative is it? For scores of 4-5: is this actually new to the field, or replicating recent work?

Scoring guide
  1. 1Negligible. No clear problem addressed, or no meaningful novelty.
  2. 2Limited. Addresses a real problem but with a generic or well-trodden approach. Incremental at best.
  3. 3Moderate. Clear problem with a reasonable approach; some novelty in framing or method beyond routine application of existing tools.
  4. 4Significant. Important problem with an original approach, or identifies a neglected problem area. A valuable contribution others could build on.
  5. 5Exceptional. Tackles a critical AI safety problem with a genuinely novel approach, or opens a new research direction. Clear theory of change. You'd be excited to share this with researchers in the area.

How sound are methodology, implementation, and findings?

Scoring guide
  1. 1Seriously flawed. Methodology broken, results uninterpretable, or implementation doesn't work.
  2. 2Weak. Approach has significant gaps: missing validation, flawed experimental design, or incomplete implementation.
  3. 3Competent. Technically solid given the short duration. Methodology makes sense, results are interpretable, limitations acknowledged, work builds toward clear conclusions.
  4. 4Strong. Thorough methodology with convincing validation. Results clearly support conclusions. Immediately useful for future work.
  5. 5Exceptional. Ambitious scope executed rigorously. Surprising findings, novel methods, or unusually robust validation.

How clearly are work, findings, and impact potential communicated?

Scoring guide
  1. 1Incomprehensible. Cannot determine what the project is actually claiming or doing.
  2. 2Hard to follow. Key information buried, missing, or diluted by excessive length. Significant effort to extract main points.
  3. 3Clear enough. Can understand the problem, approach, and results without undue effort. Core content clearly present: problem, method, findings, limitations.
  4. 4Well presented. Easy to follow, well-structured, appropriate level of detail. Target audience would get it quickly.
  5. 5Exceptionally clear. A pleasure to read. Complex ideas made accessible. Could serve as a model for how to present this type of work.

  1. This paper tackles an important problem in AI control by extending structured monitoring toward adaptive adversaries, lower monitoring costs, and cross-environment transfer. The proposed ideas—including rubric-aware adversary modeling, Constitutional Dimension Prompting, collusion detection, and Pareto-based routing—are well motivated, and the cost-performance tradeoff achieved by the routing policy is a useful practical result. The engineering infrastructure and implementation are also well organized.

    The primary weakness is the gap between the paper's claims and the experimental evidence. Several headline contributions, including robustness against adaptive adversaries and zero-shot transfer, are described but not fully evaluated, with results remaining preliminary. The paper would be significantly stronger by focusing on one core mechanism, validating it against the proposed adaptive attack model, and reporting quantitative transfer results. Aligning the abstract and conclusions with the current experimental evidence would also improve the paper's credibility.

    Overall, this is a promising systems paper with strong conceptual framing and implementation, but its central claims require more comprehensive experimental validation.

    Read full reviewShow less
  2. Extending multi-dimensional monitoring to combat collusion is a vital direction for agentic AI control. The breadth of mechanisms introduced, such as Temporal Graph-of-Thought Monitoring and Dynamic Relevance Routing, is impressive. Demonstrating that a three-dimension routing policy achieves 84% of full-ensemble AUC at a 60% API cost provides great practical value for deployment. However, the presentation feels slightly dense due to the high volume of acronyms and subsystems. Completing the pending full adaptive adversarial evaluation will be critical to proving the system's empirical robustness.

  3. To provide an overview of a very difficult challenge in AI control, this research provides a method of monitoring that can be reliable even if the monitoring agent (the controller) and the monitored agent (the controlled entity) are adversarially aligned.

    The number of different approaches presented here are numerous, especially given this was completed by one person over a single weekend. There were many innovative concepts presented here. Some examples include, using Constitutional Principles to limit the actions of the Monitor, instead of limiting the actions of the Agent. Using a Runtime Kolmogorov-Smirnov Divergence as a Collusion Signal. And Pareto Cost-Routing of Monitoring Dimensions. The author provided a model of honesty about their current understanding of their results in the Limitations Section, as well as providing an honest assessment of what they do know through the Hypotheses Appendix.

    Some possible suggestions for improving this work:

    (1). Make sure the Abstract and Conclusion accurately reflect the results of your actual experimental results. The major statement made in the Abstract regarding Robustness is based upon a Smoke Test (Direction 1) with only 2 iterations of testing and does not represent the complete experimental results. Although the authors note that the complete evaluation will occur after additional funding has been obtained, it represents the strongest statements of fact based upon experiments that have not occurred. In order to improve this work either perform a reduced evaluation of the Adaptive-Adversary Evaluation or clearly identify these mechanisms as proposed and untested.

    (2). Increase the size of your Calibration Set. The values reported (Cohen's d > .96, p < 1E-05, and AUC = .98) were generated using a total of 40 trajectories per Dimension (20 Benign and 20 Attack Trajectories). Due to having only 20 trajectories per Class, I believe your Statistics to be Fragile and Optimistic. Having at least 100 trajectories per Class (which you mentioned in Future Work), would increase the credibility of your Separation Claims, as well as require you to use a Held-Out Test Set that is independent of your Calibration Set in order to report AUC.

    (3). Provide Quantitative Evidence of Transferability. Your discussion of zero-shot transferability to Infrastructure-as-Code, Code Generation, and Web Agents states that there were promising preliminary results. Providing at least one quantitative example of transferability for each Environment would support your HiDAgT Story.

    (4). Protect Against Failure Modes of the Monitor. As several Dimensions utilize Reasoning Capabilities of Large Language Models, I suggest reporting how frequently the Judge hallucinates or reverses its decision under Prompt Changes. Additionally, I recommend evaluating how Federated Median Aggregation performs when a Majority of Judges are Compromised versus a Minority.

    Overall: a solid foundation of ideas and architectures; however, in order to further develop this body of knowledge into actionable research, we need evidence as most of your major contributions are currently architectural/hypothetical in nature, whereas most of your claims have not been validated experimentally.

    Read full reviewShow less

Cite this project

@misc{samal2026traceguardx,
  title = {{TraceGuard-X: Adaptive Collusion Resistant Monitoring for Agentic AI Systems, a hierarchical governance framework with constitutional dimension prompting, temporal trajectory analysis, and cross-environment transfer}},
  author = {AYUSH KUMAR SAMAL},
  year = {2026},
  month = jun,
  note = {Submitted to Global South AI Safety Hackathon, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/traceguardx-adaptive-collusion-resistant-monitoring-for-agentic-ai-systems-a-hierarchical-governance-framework-with-constitutional-dimension-prompting-temporal-trajectory-analysis-and-crossenvironment-transfer-huv1}},
  url = {https://apartresearch.com/sprints/projects/traceguardx-adaptive-collusion-resistant-monitoring-for-agentic-ai-systems-a-hierarchical-governance-framework-with-constitutional-dimension-prompting-temporal-trajectory-analysis-and-crossenvironment-transfer-huv1}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026