The BEiT baselines pre-trained on ImageNet and reported in Table REF  and REF  use the DALL-E tokenizer.
Other BEiT and SplitMask models have been pre-trained using our random projection tokenizer.
For the InfoNCE loss we use \(\tau =0.2\)  following [1]}.
