SEIS: Self-Evolving Inference Systems.

arXiv:2610.04646v1 Announce Type: new Abstract: Inference systems determine how fast and how cheaply language models can be served, so making them faster has direct practical value. However, prior work focuses mostly on optimizing certain parts such as kernels