LLM Alignment Survey
Free while signed in. Answers cite the passages they came from.
A comprehensive survey of LLM alignment research spanning theoretical foundations to adversarial pressure.
Outer and inner alignment: Distinguishes outer alignment (specifying the right objective) from inner alignment (ensuring the model actually pursues that objective).
Mechanistic interpretability: Reviews interpretability as an alignment tool, covering circuits, activation patching, and probing approaches.
Adversarial pressure: Catalogs known attacks on aligned LLMs including jailbreaks, prompt injection, and reward hacking.
Evaluation and directions: Discusses alignment evaluation methodologies and open problems, including scalable oversight for future systems beyond human capability.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack