BoLT: A Benchmark to Democratize Black-box Optimization Research for Expensive LLM Tasks.

arXiv:2605.17000v2 Announce Type: replace-cross Abstract: Optimization of LLM training and inference configurations, such as hyperparameters, data mixtures, and prompts, is critical to performance, but it is often approached heuristically in practice, leading