Where Rounding Happens Matters: Rounding-Location Alignment Stabilizes LLM Reinforcement Learning.

arXiv:2610.32951v1 Announce Type: cross Abstract: Reinforcement learning for large language models often uses separate systems for inference and training. Even with identical weights and BF16 tensors, implementation differences can make an intended on-policy u