Advancing SVD-based LLM Compression via Layer-Wise Error Model Search.

arXiv:2610.32878v2 Announce Type: replace Abstract: Low-rank SVD-based compression offers a powerful strategy to reduce the computational costs of LLMs. However, existing methods face two key limitations: (i) global rank allocation, where uncalibrated error pr