* Learning Rate: \(5\times 10^{-7}\)
* \(\beta\): 0.1
* Epochs: 3
* Warmup: Linear warmup for the first 10% of total training time, and then linear cooldown to a learning rate of 0 over the remaining steps.