BEiT: Since ImageNet-1k pre-trained weights are not available, we use the official BEiT code release [1]} to train ViT-B and ViT-L ourselves for 800 epochs (the default training length used in [1]}) on unsupervised ImageNet-1k.
