In-Model Context Compression with Agentic Soft Tokens for Long-Horizon LLM Agents.

arXiv:2610.41291v1 Announce Type: cross Abstract: Long-horizon LLM agents play an important role in solving complex and sustained tasks, with ever-growing interaction contexts. However, these accumulated contexts will raise substantial computational cost and o