InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization.

arXiv:2605.26175v2 Announce Type: replace-cross Abstract: Low-bit activation quantization remains a major bottleneck in efficient large language model (LLM) deployment. The difficulty is not only that activations contain outliers, but that their distributions