Humpback (Self-Alignment with Instruction Backtranslation)
Meta's Humpback automatically generates instruction-tuning data by back-translating web text into plausible instructions.
Platypus
Platypus is a family of fine-tuned and merged LLMs that topped the Open LLM Leaderboard in August 2023.
Model Compression for LLMs Survey
A survey of recent model-compression techniques applied specifically to LLMs.
GEARS
Stanford's GEARS predicts cellular responses to genetic perturbation using deep learning + a gene-relationship knowledge graph.
Shepherd
Meta's Shepherd is a 7B language model specifically tuned to critique model outputs and suggest refinements.
GPT-4 Code Interpreter for Math
A zero-shot prompting technique for GPT-4 Code Interpreter that dramatically boosts math-reasoning accuracy via code self-verification.
Teach LLMs to Personalize
A multitask-learning approach for personalized text generation without relying on predefined user attributes.
OctoPack
Hugging Face releases OctoPack, a 4TB dataset of Git commits across 350 programming languages for instruction-tuning code LLMs.
Outlines (Efficient Guided Generation)
A library for guided LLM text generation that enforces structural constraints with minimal overhead.
Bayesian Flow Networks (BFN)
Introduces a new class of generative models that combine Bayesian inference with deep learning.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack