Prune Gradually, Adapt Sparsely: Efficient Pruning of Large Language Models at Extreme Sparsity.

arXiv:2610.41968v1 Announce Type: new Abstract: Weight pruning can reduce the storage and inference cost of large language models (LLMs), but preserving quality at high sparsity levels remains challenging. Existing methods face a quality-cost trade-off in this