ToolSpace constructs realistic multi-environment tool-use benchmarks by mining execution traces, clustering tool compositions, and validating tasks through replayable state-aware random walks.
Large language models are deployed as long-horizon agents that compose diverse tools across MCP services into executable workflows. Existing MCP environment-scaling methods are data-centric: they first synthesize a database and scenario, then derive tools and tasks from them. As a result, tool interfaces may not match real ones, tool compositions are not grounded in execution, and tasks rarely span more than one environment. We propose ToolSpace, a tool-centric framework that reverses this order. ToolSpace mines data, state, and retry dependencies from adjacent calls in execution traces of real MCP services and open agent corpora, using deterministic rules rather than LLM judgment, and…
MCP servicestool-centric frameworkexecution tracesweighted tool-composition graphstate-aware random walksassertion-based checkslong-horizon tool-use benchmarks
- Upvotes
- 25
- Authors
- 25
- Published
- Nov 3, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.