May 25, 2026
Adversarial Iteration for Underspecified Program Synthesis
Amir Sarid, Uri Ariel Chen, Amit Saroussi, Nitzan Pomerantz
We introduce IDCS (Iterative Distinguishing of Code and Specs), a spec-guided pipeline that outperforms direct code generation on underspecified program-synthesis tasks. This pipeline, composed of a generator, a distinguisher, a user-proxy, and finally a coder, gets significantly better results than either using the coder directly or using the spec generator and coder alone, especially on prompts that are underspecified, unclear, or shorter than the behavior they imply. We also show that the generator and distinguisher prompts themselves can be generated through adversarial coevolution. We evaluate on three MBPP+ slices selected for hidden-edge semantics rather than algorithmic difficulty: an original five-task hard slice, a held-out hard-test split, and a nine-task fresh-failures slice. The hand-written spec-guided pipeline increases hidden-test pass rate 73.3% to 96.2% on held-out test data.
No reviews are available yet
Cite this work
@misc {
title={
(HckPrj) Adversarial Iteration for Underspecified Program Synthesis
},
author={
Amir Sarid, Uri Ariel Chen, Amit Saroussi, Nitzan Pomerantz
},
date={
5/25/26
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


