HiFloat4 Format for Language Model Pre-training on Ascend NPUs.

arXiv:2604.08826v2 Announce Type: replace-cross Abstract: Training large foundation models at low numerical precision is one of the most promising directions for reducing the compute and memory cost of modern AI. Recent 4-bit floating-point formats such as MXF