Detecting Pretraining Data in Large Language Models from a Free-Energy Perspective.

arXiv:2609.21888v1 Announce Type: cross Abstract: Detecting pretraining data in large language models is challenging because high likelihood can reflect either training exposure or strong generalization. In the joint space of prediction loss and predictive ent