FlexiFlow: Bandit-based Model Switching in ML Workflows.

arXiv:2610.07286v1 Announce Type: cross Abstract: Model optimizations help improve inference performance and accuracy of ML workflows. However, relying on a single model to perform inference across all data batches often fails to maximize accuracy and thus ove