The Undetected Damage of Quantization on Retrieval and How to Fix It.

arXiv:2609.24322v2 Announce Type: replace-cross Abstract: We show that a quantized model that keeps its classification accuracy still changes $14$ to $46\%$ of its top-1 retrieval results, and that aggregate ranking metrics reveal only part of this damage. We