The models were trained using learning rates between \(1\times 10^{-6}\) and \(5\times 10^{-5}\), which were found through a hyperparameter search. All models were trained on 4 NVIDIA A-100 GPUs for a maximum of 5 epochs and a batch size of 64.