Inference Auctions.

arXiv:2609.40070v1 Announce Type: cross Abstract: When inference demand exceeds available compute capacity, model providers must decide which requests should be served first. Users have different tolerances for delay from an LLM API, but current priority prici