Wanda
Free while signed in. Answers cite the passages they came from.
First page
The curator’s take
Key pointsA simple, effective pruning approach for LLMs requiring no retraining.
01
Weight×activation pruning: Prunes weights with the smallest magnitude × corresponding input activations on a per-output basis.
02
Zero retraining: Requires no retraining or weight updates, making it immediately deployable.
03
Simple beats complex: Outperforms magnitude-only pruning and matches or exceeds more complex training-based pruning methods.
04
Production pruning: Became a widely-adopted baseline in LLM pruning research due to its simplicity and strong performance.
Every Monday
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack