Self-supervised contrastive learning methods [1]}, [2]}, [3]}, [4]} are commonly used to pre-train a model from unlabeled data to solve a downstream task such as image classification. Contrastive learning relies on instance discrimination trained with a contrastive loss [5]} such as infoNCE [6]}.
