Weight-Adjusted Gradients Reveal Parameter Importance and Failure Modes in LLMs.

arXiv:2607.10803v2 Announce Type: replace-cross Abstract: Understanding which parameters are influential in Large Language Models (LLMs) is central to improving their efficiency, reliability, and interpretability. We introduce Weight-Adjusted Gradients (WAG),