Predictable performance is suboptimal, and what it means for model routing.

arXiv:2610.31428v1 Announce Type: cross Abstract: Large language models (LLMs) differ in capabilities and costs, motivating routing methods that adaptively choose a model for each query. These methods rely on performance prediction: given a query, estimate whe