WavePP: High-Throughput Pipeline Parallel LLM Prefill under Prefix Reuse.

arXiv:2609.35263v1 Announce Type: cross Abstract: Pipeline parallelism can improve prefill throughput by processing multiple request chunks concurrently across different stages of the model. However, keeping the pipeline fully utilized requires efficient sched