Concept Scrubbing in LLM (LEACE)

Closed-form erasure: Provides a closed-form solution for removing linearly-encoded concepts (like gender) from representations at every layer.

Theoretical guarantees: Mathematically guarantees the concept cannot be linearly recovered after erasure.

Bias reduction: Applied to reduce gender bias in BERT embeddings while minimizing impact on other capabilities.

Interpretability tool: Became a standard tool in the model-editing and interpretability literature for studying what information models use.