The RNN Homunculus: Learning to Gate Long-Term Memory.

arXiv:2610.14279v1 Announce Type: cross Abstract: Learning long-range dependencies with recurrent neural networks (RNNs) is difficult because of the vanishing gradient problem. Gated recurrent neural networks like GRUs and LSTMs address this problem and are co