Jan 11, 2026

Cross-Linguistic Sycophancy in Frontier LLMs: A Benchmark Study

Alex Csaky, Tanzim Chowdhury

🏆 3rd Place Winner

We developed a cross-linguistic sycophancy benchmark testing whether frontier AI models exhibit different manipulation behaviours across English, Japanese, and Bengali. Our results show significant language-dependent effects: Bengali users experience 37% higher opinion mirroring, and non-English users see balanced responses only half as often as English users. These findings suggest that safety alignment does not transfer uniformly across languages, creating unmeasured risks for billions of non-English speakers.

Reviewer's Comments

Reviewer's Comments

Arrow
Arrow
Arrow
Arrow
Arrow

Excellent work! More evidence that multilingual evaluations are crucial to a full safety suite. Well executed and the initial results are striking.

The main limitations (which are well acknowledged and understandable in this context) are the limited number of judges, models, and prompting approaches. I'd love to see this work expanded, especially in more realistic contexts!

Strong preliminary evidence that sycophancy behaviors could differ a lot across languages. This seems very understudied by existing work and is an important result if it turns out to be robust. Including only English, Japanese & Bengali is a limitation of the projects that obviously confounds the causal interpretation (I’m not too sold on the Hofstede Power Distance claim), but the main finding holds regardless. With expanded language coverage and more validation, I feel like this could be a solid and impactful research paper.

Cite this work

@misc {

title={

(HckPrj) Cross-Linguistic Sycophancy in Frontier LLMs: A Benchmark Study

},

author={

Alex Csaky, Tanzim Chowdhury

},

date={

1/11/26

},

organization={Apart Research},

note={Research submission to the research sprint hosted by Apart.},

howpublished={https://apartresearch.com}

}

Recent Projects

View All

View All

Feb 2, 2026

Prototyping an Embedded Off-Switch for AI Compute

This project prototypes an embedded off-switch for AI accelerators. The security block requires periodic cryptographic authorization to operate: the chip generates a nonce, an external authority signs it, and the chip verifies the signature before granting time-limited permission. Without valid authorization, outputs are gated to zero. The design was implemented in HardCaml and validated in simulation.

Read More

Feb 2, 2026

Fingerprinting All AI Cluster I/O Without Mutually Trusted Processors

We design and simulate a "border patrol" device for generating cryptographic evidence of data traffic entering and leaving an AI cluster, while eliminating the specific analog and steganographic side-channels that post-hoc verification can not close. The device eliminates the need for any mutually trusted logic, while still meeting the security needs of the prover and verifier.

Read More

Feb 2, 2026

Modelling the impact of verification in cross-border AI training projects

This paper develops a stylized game-theoretic model of cross-border AI training projects in which multiple states jointly train frontier models while retaining national control over compute resources. We focus on decentralized coordination regimes, where actors publicly pledge compute contributions but privately choose actual delivery, creating incentives to free-ride on a shared public good. To address this, the model introduces explicit verification mechanisms, represented as a continuous monitoring intensity that improves the precision of noisy signals about each actor's true compute contribution. Our findings suggest that policymakers designing international AI governance institutions face a commitment problem: half-measures in verification are counterproductive, and effective regimes require either accepting some free-riding or investing substantially in monitoring infrastructure.

Read More

This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.
This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.