When is a better LLM worth paying for? Stochastic Optimization with Switching Mixed-Fidelity Oracles
arXiv:2610.21139v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used upstream of decision-making to clean data, detect label errors, and reconstruct missing values. Yet LLM-assisted data curation creates a new operational tradeoff: higher-fidelity models and richer prompts can be substantially more expensive, while the value of this additional fidelity depends on the downstream optimization accuracy. This raises the central question of this work: when should one…