AnyTool
Free while signed in. Answers cite the passages they came from.
AnyTool is a training-free LLM agent that scales tool-use to 16K+ Rapid APIs through a hierarchical retriever and a self-reflective solver.
Hierarchical API retriever: Divides the huge API catalog into categories and tools, mirroring Rapid API's taxonomy, so the agent can focus on a small candidate set per query - a divide-and-conquer answer to context-length limits.
Solver + self-reflection: GPT-4's function calling drives a solver that attempts to resolve the query, with a self-reflection step that re-triggers retrieval and solving if the initial plan fails.
Training-free: No fine-tuning is required; the entire system is orchestration on top of GPT-4's native function calling, making it easy to deploy and adapt.
+35.4% on ToolBench: AnyTool outperforms ToolLLM on ToolBench by +35.4% average pass rate, and the paper introduces AnyToolBench as a more realistic evaluation protocol.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack