Dooly: Configuration-Agnostic, Redundancy-Aware Profiling for LLM Inference Simulation.
arXiv:2605.07985v3 Announce Type: replace-cross Abstract: Selecting the optimal LLM inference configuration requires evaluation across hardware, serving engines, attention backends, and model architectures, since no single choice performs best across all workl
arXiv cs.AIResearch source·