SchemaFill: Efficient LLM Tool Calling via Slot-Parallel Speculative Decoding.

arXiv:2610.07086v1 Announce Type: cross Abstract: LLM agents interact with external systems by generating structured tool calls. Given a user request, conversational context, and a catalog of tool schemas, a tool-calling model must select tools and generate th