Detecting Coordination Risk among AI Trading Agents: Integrating Communication and Behavioral Evidence for Financial Auditing
XIE Tengda, DU Yunhao · Team AI Auditing
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
This study develops and evaluates an audit-oriented framework for detecting coordination risk among artificial-intelligence trading agents. The framework integrates non-semantic communication structure with behavioral alignment residualised against observable market-wide and common-shock conditions. The experiment uses a rule-based synthetic data-generating process rather than a reinforcement-learning model: coordinated sets, activity periods, and labels are specified for evaluation. Four scenarios represent independent activity, explicit coordination, weak and intermittent coordination, and a no-coordination common-shock counterfactual. Across 120 runs, five agents, and 500 periods per run, the integrated logistic model achieved a mean ROC AUC of 0.852 and an F1 score of 0.684 under repeated run-grouped holdouts. A common-shock ablation reduced ROC AUC to 0.737 and F1 to 0.584, showing that raw synchrony alone is not an adequate audit signal. A nested threshold procedure targeting a 10% G4 false-positive rate produced a mean out-of-sample G4 rate of 0.092. Semi-synthetic analysis using public daily Fama-French factor backgrounds yielded an ROC AUC of 0.844 and an F1 score of 0.697, but it does not constitute real-world validation. The proposed output is therefore a transparent referral score for human review rather than a finding of unlawful conduct.
Reviews
No public critique yet.
Cite this project
@misc{tengda2026detecting,
title = {{Detecting Coordination Risk among AI Trading Agents: Integrating Communication and Behavioral Evidence for Financial Auditing}},
author = {XIE Tengda and DU Yunhao},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/detecting-coordination-risk-among-ai-trading-agents-integrating-communication-and-behavioral-evidence-for-financial-auditing-gvyx}},
url = {https://apartresearch.com/sprints/projects/detecting-coordination-risk-among-ai-trading-agents-integrating-communication-and-behavioral-evidence-for-financial-auditing-gvyx}
}More from AI Collusion Research Sprint
- View project: Collusion, Competion and Collapse
Collusion, Competion and Collapse
Atelier Alex Cline
Do AI traders collude when nobody tells them to? We built agora, a six-market benchmark with exact competitive and collusive benchmarks, and ran seven open-weight 2-4B models in 590 completed games under five …
- View project: Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Making AI Guardrails Understandable and Testable: A Framework Illustrated by a Simulated Bond Market
Rogue Agents in Jail 🕵️🕵️♀️👮♂️
In order to advance AI safety research into shaping public policy, the development of technical controls needs to have a clear purpose, evidence, and limitations that are understandable for the people responsible for …
- View project: Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Extending Information-Theoretic Collusion Detection to Large Language Model Agents
Gamma Ray
We test whether the information-theoretic collusion detector of Bonjour et al, validated on scripted agents, works on LLM agents. Gemma, Mistral and Qwen played 1000 rounds of three-player Rock-Paper-Scissors in three …