May 4, 2026
Quantifying BLAST's Sensitivity Floor for DNA Synthesis Screening
Evan Coats, Utkarsh Singh, Prithvi Vegesna, Swetha Krishnamoorthy
Benchmarks BLAST as a per-fragment screener across seven fragment lengths (20-200 bp) and six mutation rates (0-20%) under pure evasion and dilute evasion threat models. Relevant to the 2024 OSTP Framework's 50 bp screening drop in Oct 2026.
The project tackles a genuine problem, but its impact is limited by overly simple methodological choices. For instance, running the same experiments with six‑frame translated searches using BLASTX could have yielded higher detection rates for mutated fragments. Current screening guidelines imply evaluating both nucleotide sequences and their translated protein products to identify the closest match to any regulated organism.
Regarding the main conclusion, it is difficult to assume a fixed adversary capability for setting a fragment threshold when Biological AI tools can generate sequences with minimal homology to naturally occurring genes/genomes. In such cases, what matters most is the functional state of the mutated fragment or its potential to be assembled into a longer, functional sequence.
The dilute vs. pure framing is a great way to think about this!
A couple thoughts:
- The mutation model uses random per-base substitutions. Real adversaries use codon optimization, which only changes the third position of each codon. That looks different to BLAST. Worth flagging that 20% random isn't the same as 20% codon-optimized!
- You only tested BLAST, but commec is the real-world screener, which adds protein-level (DIAMOND) and HMM layers on top. Those layers might catch the dilute attacks BLAST misses. Without testing commec, the conclusion is really "BLAST alone fails," not "the OSTP threshold is inadequate".
This project tackles a well-recognised and important set of challenges in DNA synthesis screening, addressing obfuscation by mutation and split-order, as well as effects of changes in fragment-length threshold. The benchmark pipeline is a genuine and reusable artifact, and the framing of the dilute attack mode as a threat model is powerful. I would like to congratulate the authors for this piece of work generated within such a short timeframe, well done!
A limitation in the reported findings is that only one type of BLAST (blastn-short) was evaluated, which does not reflect current industry screening standards. Testing tools such as commec (as mentioned by authors), SecureDNA, and ACLID would yield far more actionable comparisons for policymakers. Given the hackathon timeframe, an alternative framing worth considering is to foreground the pipeline itself as the main contribution, which may have greater long-term impact than BLAST-specific results.
However, the benchmark itself is limited by deviations from realistic threat models. The random mutation model, while a reasonable first approximation, does not reflect how a real adversary would obfuscate sequences as they don’t preserve biological function. Although the authors acknowledged this as limitation, it does limit the direct applicability of the quantitative findings.
Cite this work
@misc {
title={
(HckPrj) Quantifying BLAST's Sensitivity Floor for DNA Synthesis Screening
},
author={
Evan Coats, Utkarsh Singh, Prithvi Vegesna, Swetha Krishnamoorthy
},
date={
5/4/26
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


