T-CCL: Resource Efficient and Performant Collective Communication using Tensor Memory Accelerator.
arXiv:2610.07098v1 Announce Type: cross Abstract: Large transformer-based models increasingly depend on multi-GPU execution, which requires frequent collective communication among GPUs. Existing communication libraries often rely on many GPU threads to achieve
arXiv cs.AIResearch source·