BudgetMem: Training-Free Selective Memory for Cost-Efficient Long-Context Processing in Language Models.

arXiv:2511.04919v3 Announce Type: replace-cross Abstract: Processing long documents with large language models (LLMs) is expensive: a single query over a 100K-token document can cost from tens of cents to over a dollar in API fees, depending on the model, and