Cache2LoRA: Understanding and Improving Context Internalization.
arXiv:2610.24107v1 Announce Type: new Abstract: Context-to-LoRA methods encode documents as low-rank parameter updates, allowing language models to answer without retaining the source text in their decoding context. How reliably do these updates preserve facts
arXiv cs.AIResearch source·