InferOpt: Constrained Multi-Objective Search for LLM Inference Configurations.

arXiv:2610.04473v1 Announce Type: new Abstract: Serving an LLM means setting dozens of inference-time knobs, from per-layer KV retention to per-layer expert counts. Practice sets them with mechanism-specific heuristics that return a single operating point and