A Cookbook of Self-Supervised Learning
Free while signed in. Answers cite the passages they came from.
First page
The curator’s take
Key pointsA comprehensive overview of SSL techniques and practical considerations.
01
Comprehensive coverage: Covers contrastive methods (SimCLR, MoCo), non-contrastive methods (BYOL, SimSiam), masked modeling (MAE, BEiT), and more.
02
Practical guidance: Provides concrete advice on hyperparameters, augmentations, and debugging - not just theoretical overview.
03
Failure modes: Documents known SSL failure modes (collapse, shortcut learning) and how to detect/mitigate them.
04
Educational resource: Widely used as a reference by graduate students and newly-SSL-curious researchers.
Every Monday
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack