Training · Data

Instruction Tuning with GPT-4

First page

Paper summary

Uses GPT-4 to generate instruction-following data for LLM fine-tuning.

Ask this paper

Key points

GPT-4 as data generator: First systematic attempt to use GPT-4 (rather than human annotators) to produce instruction-following data.

52K bilingual examples: Releases 52K unique English and Chinese instruction-following examples.

LLaMA fine-tuning: Uses the dataset to instruction-tune LLaMA models, leading to superior zero-shot performance on new tasks.

Synthetic data wave: Part of the 2023 wave establishing synthetic data from strong models as the dominant alignment data source.

Every Monday