Unlocking Structured Pruning for Reasoning Language Models via Attention-Preserving MLP Trimming.

arXiv:2610.19121v1 Announce Type: cross Abstract: Structured pruning reduces LLM inference costs by removing model components to produce smaller dense models. However, existing methods can cause reasoning performance to collapse on long-form reasoning tasks su