TokenCast: Forecasting Token Consumption During LLM Agent Execution.
arXiv:2609.35760v2 Announce Type: replace-cross Abstract: When a large language model (LLM) agent executes the same task, token consumption can vary by over an order of magnitude across runs. The agent chooses its next steps based on tool feedback and intermed
arXiv cs.AIResearch source·