Skip to content
Research

DeltaLLM: Delta-Key Sparse Attention for Edge LLMs.

arXiv:2507.19608v2 Announce Type: replace Abstract: On-device LLM inference is increasingly important for edge platforms but remains challenging due to high computational and memory demands and tight resource constraints. Modern applications often involve long

arXiv cs.AIResearch source·