Weighted State Souping for Efficient Long-Context Retrieval.

arXiv:2610.25621v1 Announce Type: cross Abstract: State space models (SSMs) combine fast inference and fixed state size with competitive language-modeling performance. Recently, state souping has been proposed as a procedure whereby an SSM independently encode