Shepherd
Free while signed in. Answers cite the passages they came from.
Meta's Shepherd is a 7B language model specifically tuned to critique model outputs and suggest refinements.
Critique-specialized 7B: A 7B parameter model fine-tuned specifically on the task of critiquing LLM responses and suggesting improvements.
Error identification: Capable of identifying diverse error types - factual, logical, stylistic, safety - and suggesting remedies for each.
ChatGPT-comparable critiques: Human evaluators judge Shepherd's critiques as similar or preferred to ChatGPT's, despite Shepherd being much smaller.
Critic-as-a-service: Points toward a deployment pattern where small specialized critic models are paired with larger generation models, a recurring theme in 2024 alignment work.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack