MoCo v3: We use the unsupervised ImageNet-1k pre-trained ViT-B and ViT-L weights from the authors of [1]} (ViT-B is public; ViT-L was provided via private communication). These models were pre-trained for 300 epochs.
