The hyperparameters used for model training are as follows: sequence length is 2048, global batch size is 128, and the maximum learning rate is \(2e^{-5}\). To prevent overfitting, weight decay is applied with a value of 0.1, and gradient clipping is enforced with a limit of 1.0.