where \(0<f(s-T)\leq 1\) is a decreasing function about \(s\), \(\eta\) is the maximum learning rate. Typically, as long as the warmup stage is enough, it affects little performance, therefore, we omit \(W\) in the subsequent discussion.