Characterizing Parallelism Strategies in LLM Inference: Fundamental Compute-Communication Trade-offs.

arXiv:2610.05305v1 Announce Type: cross Abstract: Large Language Model (LLM) inference has become the dominant workload in modern AI systems, requiring serving infrastructures to maximize throughput while meeting strict latency Service-Level Objectives (SLOs).