Aperture: Merge-Consistent Rotary States for Compressed Tokens.
arXiv:2609.36781v1 Announce Type: new Abstract: Token compression combines content from several positions, yet rotary position embeddings usually assign the merged token one coordinate. We ask what positional information must survive later merges. Aperture sto
arXiv cs.AIResearch source·