Training parameters.We employ the AdamW optimizer with a cosine learning rate scheduler. This includes \(1\)K steps of warmup, followed by a cosine decay of the learning rate from \(1\) to \(0.1\) times the reference rate. We use mixed-precision fp16 training unless otherwise stated.