We fine-tune the linear head for 25 epochs with a learning rate drop after 20 epochs and a batch size of 120.
For most checkpoints we found a learning rate of 0.01 to work well except for the baselines of MaskContrast [1]} and MoCo-v2 [2]} where we use a learning rate of 0.1.
All heads were trained on downsampled 100x100 masks to increase training speed.
For evaluation, we stick to 448x448 masks as it does not require Hungarian matching and is thus fast.
