Audio Token Attention Is Predictable Before the Language Model Runs.

arXiv:2609.38878v1 Announce Type: cross Abstract: A large audio language model (LALM) turns a minute of speech into 750-1,500 tokens and prefills every one. Image-token pruning often cuts after the language model's first layers, where image tokens draw little