For iWildCam-WILDS full-finetuning, we initialize the model weights from the SEER model full-finetuned on iNaturalist18 (following the guideline [1]}) and attach a linear 182 dimensional MLP head and full-finetune the model. We use SGD momentum of \(0.9\)  to finetune for 60 epochs, weight decay of \(1e-4\) , step learning rate schedule with learning rate of \(0.001\)  decayed at epochs [10,40] by gamma \(0.1\) . We use global SyncBatchNorm to synchronize statistics across all GPU workers and also regularize BatchNorm and bias in the model layers.
