RECAP: Calibrating Low-Bit Reasoning Models on the History They Read.
arXiv:2610.15259v1 Announce Type: new Abstract: Low-bit quantization reduces the cost of serving reasoning models but can substantially degrade long chains of thought. Each step reads cached keys and values spanning thousands of tokens, allowing quantization e
arXiv cs.AIResearch source·