Skip to content
Research

Few Bits, One Law: Toward W2A4KV2.

arXiv:2610.09202v1 Announce Type: new Abstract: Extreme low-bit LLM compression is most challenging when weights, activations, and KV caches are quantized together: their distributions differ, and quantization errors interact throughout the network. We introdu

arXiv cs.AIResearch source·