ToolLLM
First page

Paper summary
Tsinghua's ToolLLM enables LLMs to interact with 16,000+ real-world APIs through a comprehensive framework for tool-using LLMs.
Ask this paper
01
16K APIs: Covers 16,000+ real-world APIs - orders of magnitude more than prior tool-use benchmarks, capturing the real diversity of modern API ecosystems.
02
Full-stack framework: Includes data preparation, training methodology, and evaluation infrastructure - a complete open stack for tool-use research.
03
ToolLLaMA hits ChatGPT-16k: The authors' ToolLLaMA model matches ChatGPT (turbo-16k) on tool-use benchmarks, showing open models can close the gap.
04
Tool-use research foundation: Became a standard reference point for tool-use research, influencing how tool datasets and benchmarks were structured through 2024.