Skip to content
Research

You Cannot Pick a Provider From the Price List: Market-Aware Routing for Open-Weight LLM Inference.

arXiv:2609.37902v1 Announce Type: new Abstract: Existing LLM routers choose among models using static per-model costs. We show that open-weight inference markets introduce a second, largely ignored decision axis: after choosing a model, a client must still cho

arXiv cs.AIResearch source·