Training

A Cookbook of Self-Supervised Learning

First page

Paper summary

A comprehensive overview of SSL techniques and practical considerations.

Ask this paper

Key points

Comprehensive coverage: Covers contrastive methods (SimCLR, MoCo), non-contrastive methods (BYOL, SimSiam), masked modeling (MAE, BEiT), and more.

Practical guidance: Provides concrete advice on hyperparameters, augmentations, and debugging - not just theoretical overview.

Failure modes: Documents known SSL failure modes (collapse, shortcut learning) and how to detect/mitigate them.

Educational resource: Widely used as a reference by graduate students and newly-SSL-curious researchers.

Every Monday