RCStat: A Statistical Framework for using Relative Contextualization in Transformers.
arXiv:2506.19549v2 Announce Type: replace-cross Abstract: Identifying which tokens and activations truly influence model predictions is critical for both the efficiency and interpretability of large auto-regressive language models. Yet in practice, token impor
arXiv cs.AIResearch source·