Effective Does Not Mean Useful: Conditional Functional Substitutability for Redundancy and Scaling in Transformers.

arXiv:2609.39259v1 Announce Type: new Abstract: Modern neural networks scale predictably, yet the mechanisms behind these regularities remain unclear. Neural redundancy is typically characterized by component importance or representational similarity, both ind