DPS: Dual-Mode Precision LLM Serving with Semi-Unified Memory.

arXiv:2609.34380v1 Announce Type: cross Abstract: Existing LLM serving systems virtualize and optimize KV-cache memory, but treat model-weight memory as fixed throughout execution. Recent work on multi-precision model representations challenges this design by