Jun 2, 2025
A generalist Router for Inspect: Reasoning router demonstration
Ishan Garg, Aman Neelappa, Gerard Boxo, Alan McBeth
Summary
With hundreds of AI models available today, choosing the right model for each query is expensive and inefficient. We develop a system that learns compact "fingerprints" of different models and automatically routes questions to the most cost-effective option. Our approach achieves 96% of premium reasoning model accuracy while cutting costs in half, making advanced AI capabilities accessible without breaking the bank. The key innovation: instead of using generic question embeddings, we let each model "see" questions through its own lens, dramatically improving routing decisions.
Cite this work:
@misc {
title={
@misc {
},
author={
Ishan Garg, Aman Neelappa, Gerard Boxo, Alan McBeth
},
date={
6/2/25
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}
