From Attention Sensitivity to Layer Role: Revisiting Mixed-Precision Quantization of Transformers.

arXiv:2609.34866v1 Announce Type: cross Abstract: Most post-training quantization pipelines fit each weight matrix to its pretrained counterpart, one matrix at a time. Whether that proxy tracks what an attention block actually computes, or how errors in the Q,