Auditing Routing Entropy as an Uncertainty Signal in Attention-Residual Transformers.
arXiv:2610.01495v1 Announce Type: new Abstract: Dynamic architectures leave a per-example routing trace beside each prediction, and diffuse routing is easy to read as a sign that the prediction is unreliable. We audit that reading for routing entropy in Attent
arXiv cs.AIResearch source·