JustQuant: You Don't Need Smoothing, SVD, or Rotation for 4-Bit Activation Quantization.

arXiv:2609.33601v1 Announce Type: new Abstract: Recent generative models have become increasingly powerful, but their inference cost continues to grow. Model quantization offers a promising way to compress these models and accelerate inference. However, at 4 b