Humpback (Self-Alignment with Instruction Backtranslation)
Meta's Humpback automatically generates instruction-tuning data by back-translating web text into plausible instructions.
Ask this paper
Instruction backtranslation: Given a web document, generates a plausible instruction that the document could answer - inverting the typical instruction-data creation direction.
Four-step pipeline: (1) Fine-tune LLM with small seed data, (2) generate instructions for web docs, (3) self-curate high-quality examples, (4) fine-tune on curated data.
Tops Alpaca leaderboard: The self-aligned model outperforms all other Llama-based models on the Alpaca leaderboard at the time of release.
Data abundance: Turns the entire web into potential instruction-tuning data, dramatically expanding the accessible instruction corpus beyond curated human-written datasets.