Power- and Fragmentation-aware Online Scheduling for GPU Datacenters.

arXiv:2412.17484v2 Announce Type: replace-cross Abstract: The rise of Artificial Intelligence and Large Language Models is driving increased GPU usage in data centers for complex training and inference tasks, impacting operational costs, energy demands, and th