The SimCLR [1]} algorithm consists of self-supervised pretraining and supervised fine-tuning. SimCLRv2 [2]} incorporates approximately the same steps, but adds a final knowledge distillation [3]} stage that has been found powerful in inductive SSL (see [2]} for further details).
