Mind the Spike: Mechanisms and Brittleness of Visual Massive Activations in Large Vision-Language Models.

arXiv:2609.32808v1 Announce Type: cross Abstract: Large vision-language models (LVLMs) inherit massive activations from their text-only bases: spikes where a few fixed hidden channels receive values thousands of times above the typical magnitude. The text spik