Rethinking Quality in Large Language Model Routing: Security-Conditioned Model-and-Budget Selection.
arXiv:2610.18566v2 Announce Type: replace Abstract: Large language model (LLM) routers reduce serving cost by choosing which model to call and how many output tokens to grant it for each query. Existing routers rank model-budget actions using a single quality
arXiv cs.AIResearch source·