LMFlow
First page

Paper summary
An extensible and lightweight toolkit for fine-tuning and inference of large foundation models.
Ask this paper
01
Full training stack: Supports continuous pretraining, instruction tuning, parameter-efficient fine-tuning, alignment tuning, and inference in one toolkit.
02
Lightweight design: Easier to use and extend than heavier frameworks like Megatron or DeepSpeed for practitioners who want to iterate quickly.
03
Community adoption: Became a popular tool in the open-source LLM ecosystem for reproducing fine-tuning recipes.
04
Training ecosystem: Part of the broader 2023 proliferation of accessible LLM training tooling (Axolotl, LLaMA-Factory, LitGPT) that enabled community fine-tuning.