DeltaLLM: Delta-Key Sparse Attention for Edge LLMs.
arXiv:2507.19608v2 Announce Type: replace Abstract: On-device LLM inference is increasingly important for edge platforms but remains challenging due to high computational and memory demands and tight resource constraints. Modern applications often involve long
arXiv cs.AIResearch source·