Skip to content
Sprint projectJan 11, 2026Barcelona

Dark Drift: Emergent Psychopathic Traits and Information Distortion in LLM-Mediated Communication Chain

Chengheng Li Chen, Babita Singh, David Bravo, Publius Dirac · Team Dark_Drift

Submitted to AI Manipulation Hackathon. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Dark Drift: Emergent Psychopathic Traits and Information Distortion in LLM-Mediated Communication Chain

Code (opens in new tab)
Share

We investigate "Dark Drift," a phenomenon where iterative multi-agent communication degrades ethical alignment and factual accuracy. Using a "Telephone Game" simulation with eight distinct personas (ranging from "Helpful Assistant" to "Explicit Psychopath") and 26 ethically charged scenarios, we tracked information distortion across 5-step chains using diverse LLMs (GPT-OSS-20B, Qwen3-32B). Results from 6,240 scored interactions reveal that high-risk personas exhibit a self-reinforcing escalation of harmful traits (+15.2 points in drift), while "professional" personas mask harm through bureaucratic language ("Bureaucratic Masking"). We identify strong cross-model correlation (r=0.97) and propose that defensive personas can act as effective circuit breakers.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Your private critique is not published; only the Apart team reads it. If you agree below, we share your review with grantmaking.ai (opens in new tab) and the Transformative AI Fund so strong projects can be funded.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Share my name publicly on grantmaking.ai *
Share my private critique with funders *

How much would this matter for AI safety if it worked? How innovative is it? For scores of 4-5: is this actually new to the field, or replicating recent work?

Scoring guide
  1. 1Negligible. No clear problem addressed, or no meaningful novelty.
  2. 2Limited. Addresses a real problem but with a generic or well-trodden approach. Incremental at best.
  3. 3Moderate. Clear problem with a reasonable approach; some novelty in framing or method beyond routine application of existing tools.
  4. 4Significant. Important problem with an original approach, or identifies a neglected problem area. A valuable contribution others could build on.
  5. 5Exceptional. Tackles a critical AI safety problem with a genuinely novel approach, or opens a new research direction. Clear theory of change. You'd be excited to share this with researchers in the area.

How sound are methodology, implementation, and findings?

Scoring guide
  1. 1Seriously flawed. Methodology broken, results uninterpretable, or implementation doesn't work.
  2. 2Weak. Approach has significant gaps: missing validation, flawed experimental design, or incomplete implementation.
  3. 3Competent. Technically solid given the short duration. Methodology makes sense, results are interpretable, limitations acknowledged, work builds toward clear conclusions.
  4. 4Strong. Thorough methodology with convincing validation. Results clearly support conclusions. Immediately useful for future work.
  5. 5Exceptional. Ambitious scope executed rigorously. Surprising findings, novel methods, or unusually robust validation.

How clearly are work, findings, and impact potential communicated?

Scoring guide
  1. 1Incomprehensible. Cannot determine what the project is actually claiming or doing.
  2. 2Hard to follow. Key information buried, missing, or diluted by excessive length. Significant effort to extract main points.
  3. 3Clear enough. Can understand the problem, approach, and results without undue effort. Core content clearly present: problem, method, findings, limitations.
  4. 4Well presented. Easy to follow, well-structured, appropriate level of detail. Target audience would get it quickly.
  5. 5Exceptionally clear. A pleasure to read. Complex ideas made accessible. Could serve as a model for how to present this type of work.

  1. This paper looks at how messages change when they are passed through series of transformations through models with various personalities. The idea is to see how the effect of model dispositions at the end of a chain of communication presumably with substantial real-world implications insofar as such chains of communications will be implemented across real-world infrastructure.

    I really like this paper. I think it identifies an important question and a clever methodology for evaluating it. It admirably tries to handle multi-turn interaction, albeit in a simple format. Demonstrating that these effects vary substantially with personalities but not with models seems like an important finding.

    The main thing that I would have wished to see more was contextualizing the upshot of this. I had a hard time reading the paper and understanding why this would matter, and eventually managed to reconstruct that for myself when I saw the implementation of these chains in real-world applications. I wished I would have been front-loaded more and recommend the authors to make such amendments if they develop this project. I also think that the paper could probably be shortened and the results made a little bit clearer.

    In future work, it would be interesting to see how different personalities interact within the same chains, generating a very large amount of chains and looking for surprising interaction effects, for example, whether one personality can reverse the effect of another, or not.

    Read full reviewShow less
  2. This project investigates persona amplification across iterative rewrites, running 6,240 experiments across 2 models, 8 personas, and 26 ethical scenarios. The experimental scale demonstrates solid effort, and the "Bureaucratic Masking" observation (where professional personas maintain low risk scores while still distorting information) is worth exploring further.

    The primary limitation is the experimental setup: the work frames itself as studying "multi-agent communication" and positions within a manipulation context, but the actual implementation has a single LLM rewriting its own output 5 times with the same persona prompt at temperature 0. This means there's no agent-to-agent interaction, no dynamics between different agents with competing goals, and no manipulation behavior -- just amplification of a single persona's tendencies through self-iteration.

    Testing actual multi-agent interactions would be particularly valuable for understanding real-world failure modes in orchestrated agentic systems beyond coding applications. For example: does an adversarial agent corrupt a helpful agent's outputs over time? Do defensive personas mitigate drift when alternated with adversarial ones? These questions feel more aligned with practical safety concerns.

    Additional methodological concerns: (1) missing baseline comparing single-shot vs. iterative rewrites to isolate iteration effects, (2) persona prompts and scenarios aren't included in the paper itself, requiring readers to check GitHub, (3) limited statistical analysis despite large sample size -- few confidence intervals or significance tests, (4) judge scores lack human validation for subjective metrics.

    The core finding, that personas amplify under recursive self-prompting, is interesting but somewhat expected at temperature 0. The work would benefit from clearer framing around what was actually tested and addition of controls that isolate the causal mechanisms driving drift.

    Read full reviewShow less

Cite this project

@misc{chen2026dark,
  title = {{Dark Drift: Emergent Psychopathic Traits and Information Distortion in LLM-Mediated Communication Chain}},
  author = {Chengheng Li Chen and Babita Singh and David Bravo and Publius Dirac},
  year = {2026},
  month = jan,
  note = {Submitted to AI Manipulation Hackathon, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/dark-drift-emergent-psychopathic-traits-and-information-distortion-in-llmmediated-communication-chain-dca4}},
  url = {https://apartresearch.com/sprints/projects/dark-drift-emergent-psychopathic-traits-and-information-distortion-in-llmmediated-communication-chain-dca4}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026