Silent and Costly: Characterizing and Detecting Prompt-Caching Mis-Integration in LLM Agents.

arXiv:2610.34817v2 Announce Type: replace-cross Abstract: Large language model (LLM) services process massive volumes of user requests, resulting in substantial inference costs. To reduce both cost and latency, providers have introduced prompt caching. However