CoS-VQ: Coordinated Shared-Scale Vector Quantization for Large Language Models.

arXiv:2610.37336v1 Announce Type: cross Abstract: Large language models (LLMs) require substantial memory, motivating low-bit weight quantization for efficient deployment. Existing vector quantization (VQ) methods often improve accuracy by increasing the effec