It is mentioned that L2 regularization is used. is the learning rate. is the regularization parameter.m is the mini batch sizeI think that if n then there would be a very negligible effect of regularization.So wouldn't the change of weight depend just on the partial derivative of the Cost function(C) with respect to the Weight(w)I don't understand how the decay factor can be exponential.This a question taken from the book Neural Networks and Deep Learning by Michael Nielson.
Prove that the weights will decay by a factor of exp(/m) per epoch when n
machine learning;neural networks