How to Compress KV Cache in RL Post-Training? Shadow Mask Distillation for Memory-Efficient Alignment.

arXiv:2605.06850v2 Announce Type: replace-cross Abstract: Reinforcement Learning (RL) has emerged as a crucial paradigm for unlocking the advanced reasoning capabilities of Large Language Models (LLMs), encompassing frameworks like RLHF and RLAIF. Regardless o