Humpback (Self-Alignment with Instruction Backtranslation)
Meta's Humpback automatically generates instruction-tuning data by back-translating web text into plausible instructions.
Platypus
Platypus is a family of fine-tuned and merged LLMs that topped the Open LLM Leaderboard in August 2023.
Model Compression for LLMs Survey
A survey of recent model-compression techniques applied specifically to LLMs.
GEARS
Stanford's GEARS predicts cellular responses to genetic perturbation using deep learning + a gene-relationship knowledge graph.
Shepherd
Meta's Shepherd is a 7B language model specifically tuned to critique model outputs and suggest refinements.
GPT-4 Code Interpreter for Math
A zero-shot prompting technique for GPT-4 Code Interpreter that dramatically boosts math-reasoning accuracy via code self-verification.
Teach LLMs to Personalize
A multitask-learning approach for personalized text generation without relying on predefined user attributes.
OctoPack
Hugging Face releases OctoPack, a 4TB dataset of Git commits across 350 programming languages for instruction-tuning code LLMs.
Outlines (Efficient Guided Generation)
A library for guided LLM text generation that enforces structural constraints with minimal overhead.
Bayesian Flow Networks (BFN)
Introduces a new class of generative models that combine Bayesian inference with deep learning.