Dynamical Memory Transformer: Selective Recurrent Memories with Constant Cost Attention.

arXiv:2610.41850v1 Announce Type: new Abstract: Transformers retain an explicit history of the sequence, allowing attention to directly retrieve past representations. However, the size of the KV-Cache and the cost of a new token increase with the context lengt