Fast LapSum: Exact Differentiable Top-$k$ at Million Scale.
arXiv:2608.06912v3 Announce Type: replace Abstract: Selecting the top-$k$ elements is a fundamental operation for inducing sparsity in large-scale models and optimization problems, enabling robust expert activation, token routing or attention pruning. However,
arXiv cs.AIResearch source·