We use an Adam [1]} optimizer with a fixed learning rate of 1e-03, weight decay of 1e-05, and amsgrad set to true. We run all our experiments for 200 epochs with a batch size of 64, using a binary cross-entropy with logits as our loss function.
We perform early stopping [2]}, and use the final best validation model state, for our inference.
