Similarity Is Not Validity: Defending LLM Semantic Caches Against Poisoning.
arXiv:2609.35908v1 Announce Type: cross Abstract: Semantic caches reduce LLM serving costs by reusing previously generated answers for semantically similar queries. However, retrieval is based solely on embedding similarity between the incoming query and cache
arXiv cs.AIResearch source·