Wanda

Weight×activation pruning: Prunes weights with the smallest magnitude × corresponding input activations on a per-output basis.

Zero retraining: Requires no retraining or weight updates, making it immediately deployable.

Simple beats complex: Outperforms magnitude-only pruning and matches or exceeds more complex training-based pruning methods.

Production pruning: Became a widely-adopted baseline in LLM pruning research due to its simplicity and strong performance.