Copy-Paste Language Models.

arXiv:2610.19247v1 Announce Type: cross Abstract: Transformers are intuitively considered to be efficient at copying from their inputs. We actually show that the ability of LLMs to copy in context can be improved through explicit modeling. We propose Copy-Past