DynBranch: Speculative Subgraph Reuse for Dynamic Agentic LLM Serving.
arXiv:2609.31047v1 Announce Type: cross Abstract: Agentic LLM workflows decide their execution paths at runtime. Downstream computation may be predictable, or may have run before, yet it cannot begin until the model or the user resolves the branch. We call thi
arXiv cs.AIResearch source·