RouterWorld: Scaling Conversational AI with Latency-Aware LLM Routing.

arXiv:2610.26511v1 Announce Type: new Abstract: Conversational AI systems built on Large Language Models (LLMs) require routing mechanisms that balance answer quality and response latency at scale. However, existing LLM routing benchmarks assume full observabi