TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token Pruning.

arXiv:2610.26754v1 Announce Type: cross Abstract: Expert human readers process large inputs (e.g., code repositories and long documents) by skimming to closely read only what matters. On the other hand, language models process all input tokens through each mod