Surfing the Activation Wave: Analyzing the Information and Geometry of LLM Hidden States for Speculative Decoding.

arXiv:2610.12939v1 Announce Type: cross Abstract: Decoder hidden states from different layers of large language models (LLMs) often encode complementary information. However, existing speculative decoding methods typically rely on a small set of target-model l