Skip to content
Research

RECAP: Calibrating Low-Bit Reasoning Models on the History They Read.

arXiv:2610.15259v1 Announce Type: new Abstract: Low-bit quantization reduces the cost of serving reasoning models but can substantially degrade long chains of thought. Each step reads cached keys and values spanning thousands of tokens, allowing quantization e

arXiv cs.AIResearch source·