TRACE: Transformer Residual Activation Codebook Encoding for Communication-efficient Distributed Edge Inference.

arXiv:2610.22435v1 Announce Type: cross Abstract: Distributed Transformer inference across co-located edge devices is fundamentally communication-bound, as exchanging activations between sequence-parallel partitions dominates inference latency under commodity