A Persistent State for Auditable Mixture-of-Experts Routing.
arXiv:2609.34634v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models repeatedly route tokens to sparse subsets of experts, but conventional routers expose no routing-specific record of how cross-layer influences accumulate. We introduce Scratchpad-A
arXiv cs.AIResearch source·