HHR: Hierarchical Hash Retrieval for Efficient LLM Generation.

arXiv:2610.01230v2 Announce Type: replace Abstract: Efficient long-context inference is essential for large language models (LLMs), yet it poses a severe computational bottleneck. Hash-based retrieval offers an efficient alternative by encoding queries and key