We remark that recent works also attempt to accelerate the convergence of gradient descent to its implicit regularization, either by using an aggressive step size schedule [1]}, [2]} or with momentum [3]}.
Further, there have been several results for other optimization methods, including steepest descent, AdaBoost, and various adaptive methods such as RMSProp and Adam [4]}, [5]}, [6]}, [7]}. However, to the best of our knowledge, there is no result for mirror descent in the classification setting.
