Scepsy: Serving Agentic Workflows Using Aggregate LLM Pipelines.

arXiv:2604.15186v3 Announce Type: replace-cross Abstract: Agentic workflows carry out complex tasks by orchestrating multiple large language models (LLMs) and tools. Serving them at a target throughput with low latency is hard because they are written in arbit