Learning the Cost of Reliable Inference.

arXiv:2609.28322v2 Announce Type: replace Abstract: Benchmarking and routing platforms increasingly act as intermediaries connecting large language model providers with end-users. However, providers on these platforms typically use a fixed price per token, pre