Sparse Text Diffusion under Dual Budgets: Context Connectivity and Expert Activation.
arXiv:2610.41487v1 Announce Type: cross Abstract: Long-context diffusion repeatedly pays for both token interaction and feed-forward computation. We formulate these costs as two separate budgets: the edges available to an attention graph and the experts activa
arXiv cs.AIResearch source·