Self-supervised learning: The task of learning representations by solving a pretext task without using any supervised annotations is called self-supervised learning. Various pretext tasks like solving jigsaw puzzles [1]}, predicting rotations [2]}, counting the visual primitives [3]}, filling up a missing patch [4]}, predicting missing channels of input [5]}, [6]}, and contrastive learning [7]}, [8]} are explored in the literature. We are proposing a novel pretext task based on iterative similarity based distillation.
