Attention Sinks in VLMs Are Borrowed, Not Seen.
arXiv:2610.15855v2 Announce Type: replace Abstract: We study how to detect and mitigate visual attention sinks in vision-language models (VLMs). Visual attention sinks are image tokens that absorb a large share of attention over the image regardless of the que
arXiv cs.AIResearch source·