False Epistemic Redundancy: Do AI Ensembles Share a Blind Spot?
Sofia Gallego, Anya Habana
When multiple AI personas that differ in terms of cognitive reasoning appear to explore a problem differently, how much genuine epistemic coverage is actually gained and which tails might they still collectively miss? We explore whether prompting the same AI from different perspectives broadens the hypotheses it considers, particularly toward the less obvious “tails” where rare but consequential explanations may lie. Across our real-world cases, no persona consistently recovered the true explanation. Instead, success varied by case and framing, even when agents were given the evidence that ultimately led human investigators to the solution. At the same time, persona prompting on the basis of causal, analogical, teleological, and dialectical reasoning consistently increased the apparent diversity of responses. In this small pilot, greater response diversity therefore did not reliably correspond to better coverage of the consequential hypothesis, implying that surface level model prompting may be insufficient at inducing epistemic diversity, calling for methods that target deeper model activations.
This is a smart, focused project and the results are provocative, but the direction depends heavily on the case structure. The confidence finding is also worth highlighting, so though this is a small pilot (one model, small N) it makes the pattern credible. I hope you take this to the next level with more cases and more models.
The question is interesting, but I think the choice of questions and personas was strange; I would guess that epistemic diversity from personas is more interesting/valuable in contentious value-laden questions.
It's also hard to know how much to trust the results without seeing transcripts, or knowing how reliable your LLM graders are.
Cite this work
@misc {
title={
(HckPrj) False Epistemic Redundancy: Do AI Ensembles Share a Blind Spot?
},
author={
Sofia Gallego, Anya Habana
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


