Which Long Documents Matter? A Controlled Study of Data Selection for Context Extension.

arXiv:2610.24469v1 Announce Type: cross Abstract: Natural long documents are widely used for context extension, but which selection pipelines are effective remains unclear. We conduct a controlled comparison on Qwen2.5-3B at 128K under matched 6B-token continu