LLM Explains Neurons in LLMs

GPT-4 as interpreter: Uses GPT-4 to generate natural-language explanations of what individual GPT-2 neurons detect.

Automated scoring: Also uses GPT-4 to score how well an explanation predicts the neuron's actual activations on new text.

Scale of interpretability: Enables scaling interpretability research to all neurons in a model, previously impractical with human effort.

Automated interpretability era: Sparked the automated interpretability research program that continued in 2024 with SAE-based techniques and Golden Gate Claude demos.