KBBQ: A Predictive Noise Law and the Limits of Spectrum Flattening in FP4 Quantization.

arXiv:2609.08135v2 Announce Type: replace-cross Abstract: We develop a second-order theory of quantization noise in matrix multiplication in which the quantization format is characterized by the variance it assigns to each element. The constant variance profil