Progress with Stochastic Gradient Descent part2(Machine Learning)
Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent(arXiv) Author : Benjamin Gess, Sebastian Kassing, Vitalii Konarovskyi Abstract : We propose new limiting dynamics for stochastic gradient descent in the small learning rate regime called stochastic modified flows. These SDEs are driven by a cylindrical Brownian motion and…
Progress with Stochastic Gradient Descent part2(Machine Learning) Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent(arXiv) Author : Benjamin Gess, Sebastian Kassing, Vitalii Konarovskyi Abstract : We propose new limiting dynamics for stochastic gradient descent in the small learning rate regime called stochastic modified flows. These SDEs are driven by a cylindrical Brownian motion and… deep-learning
Progress Stochastic Gradient Descent part2Machine Learning Stochastic Modified Flows MeanField Limits Dynamics Stochastic Gradient DescentarXiv Author Benjamin Gess Sebastian Kassing Vitalii Konarovskyi Abstract propose new limiting dynamic stochastic gradient descent small learning rate regime called stochastic modified flow SDEs driven cylindrical Brownian motion and… deeplearning