Evidence Conflicts Before Verdicts
Flamur Koca · Team QENDROVA
Submitted to AI Collusion Research Sprint. Sprint projects are early-stage work by participants, not Apart Research publications.
Across three synthetic inputs and six archived model responses, an equal-authority evidence conflict was incorrectly classified as valid under both a full task and a validity-only task. Post-hoc suppression withheld both incorrect conflict responses but reduced coverage and left other errors visible. Correct conflict rejections were absent from that archive, so their loss rate is unknown. A constructed routing demonstration exposed two correct conflict mentions alongside four false sentence units and one unsupported claim in a blocked review channel. A pre-sprint certificate check supported three known open judgments and rejected three defective controls. A separately authorized 23 October offline restart evaluated six synthetic views prepared for an earlier technically aborted attempt. Four source-bound, manually AI-typed in-scope mappings yielded 16 reference-matching labels, including three open judgments with compatible opposite-valued witnesses. Two further views were stopped by manual scope decisions. A separate 24 October language-transfer exercise used six new prose cases, prepared on 23 October, in the same two contexts. Four in-scope mappings produced 16 reference-matching labels and five open axes with opposing compatible witnesses; two manual scope stops were supported. Neither exercise establishes general transfer, automatic extraction, model improvement, or collusion detection. There is no independent holdout or human reference validation. Source authority and completeness are stipulated. The original abort remains documented. Earlier diagnostics and checks are pre-sprint work; both transfer exercises are dated sprint-period work. Sanitized L01-L06 reading evidence is now available as L1; the V01-V06 restart records remain local.
Reviews
No public critique yet.
1 judge declined to score this project.
Cite this project
@misc{koca2026evidence,
title = {{Evidence Conflicts Before Verdicts}},
author = {Flamur Koca},
year = {2026},
month = oct,
note = {Submitted to AI Collusion Research Sprint, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/evidence-conflicts-before-verdicts-zmjz}},
url = {https://apartresearch.com/sprints/projects/evidence-conflicts-before-verdicts-zmjz}
}More from AI Collusion Research Sprint
- View project: Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence ? Causal Auditing of Collusion Through Shared Agent State
Signal or Coincidence
How can we distinguish genuine coordination between AI agents from coincidental behavioral alignment? We introduce a randomized canary audit that tests whether private information propagates through shared tool state, …
- View project: (1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
(1.4) Collusion, Espionage, or Look-alikes? Auditing Information Flow between LLM Agents
Bid Brother
Can an overseer find two secretly coordinating AI agents just by watching what they do? We tested pairwise net influence (Bonjour et al., 2022) on LLM bidders in a repeated procurement auction, with instructed cartels …
- View project: AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
AI Sellers Propose Bid-Rigging Within Minutes, but Their Agreements Do Not Hold
Fugue
AI agents are starting to negotiate and bid for competing companies. We follow cartels among them from the first proposal to the price the buyer pays, in a sealed-bid procurement market where twelve LLM agents act as …