BitMTP: When Multi-Token Prediction Meets Low-Bit Large Language Models.

arXiv:2610.28500v1 Announce Type: cross Abstract: For efficient deployment of large language models (LLMs), methods of ultra-low-bit backbones reduce weight storage, memory traffic, and linear-layer execution cost, while multi-token prediction (MTP) methods re