Are Emergent Abilities of LLMs a Mirage?
Free while signed in. Answers cite the passages they came from.
First page
The curator’s take
Key pointsStanford's critical re-examination of emergent abilities.
01
Metric-choice argument: Argues "emergence" is often an artifact of using discontinuous metrics (like exact match) rather than smooth ones (like log-probability).
02
Metric substitution: When re-analyzing with continuous metrics, many "emergent" capabilities appear smoothly with scale.
03
Research methodology: Cautions the field against interpreting metric-choice artifacts as fundamental phase transitions.
04
Best Paper at NeurIPS 2023: Influential paper that sparked extensive debate about what "emergence" really means in LLMs.
Every Monday
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack