Don't Mask the Environment: Observation Supervision Changes How Agents Explore Under RL.

arXiv:2609.20715v1 Announce Type: cross Abstract: Agent trajectories record what an agent does and what happens next. Yet standard supervised fine-tuning (SFT) applies loss only to agent-authored action tokens, using environment observations as context but not