LARC [1]} scales the learning rate of each layer \(l\)  based on the norm of the parameters \(w^l\) , the norm of the gradient of the parameters \(\nabla w^l\) , the weight decay \(\beta \)  and a trust coefficient \(\eta \) , following the formula:
\(\lambda ^l = \eta \frac{||w^l||}{|| \nabla w^l || + ||w^l|| * \beta }\) 
