In this section, we will introduce how exactly SSL methods train models on unsupervised datasets in a supervised manner. We will discuss two ways of using pretext tasks to train the model – pretext-covariant learning methods and pretext-invariant learning methods. The discussion will be based on the work \(\dagger \)  Pretext-Invariant Representation Learning (PIRL) [1]} PIRL is the main artifact in this section..
