ARK: Avoiding Routing Collisions for KV Cache Transfer in Disaggregated LLM Inference.

arXiv:2610.41160v1 Announce Type: cross Abstract: Disaggregated LLM inference separates the prefill and decode phases across GPU pools, generating massive KV-cache transfers. Because these transfers last hundreds of milliseconds to seconds, they behave as mega