Counting Documents Is Not Counting Text: Unit Bias in Web-PDF Corpus Statistics.
arXiv:2608.16390v2 Announce Type: replace-cross Abstract: PDF corpora advertise their size in tokens, but every rate they publish (coverage, OCR routing, re-fetch recovery, language mix) is computed per document, and none decomposes its token total. Because PD
arXiv cs.AIResearch source·