Let the Gate Decide: Per-Lookup Precision for Quantized Conditional Memory in LLMs.

arXiv:2610.35985v1 Announce Type: cross Abstract: Conditional memory layers, such as DeepSeek's Engram, attach large hashed n-gram tables to a language model, and removing them from DeepSeek-V4.1-Flash costs 36.8 PopQA points. Low-bit quantization loses long-t