Moreover, the analysis will allow for any SF distribution with bounded support. This includes resetting SF distributions that yield resetting learning rate schemes, which have been shown to improve optimization performance ([1]}, [2]}). A Resetting-MSLR scheme will be referred to as RMSLR. If, moreover, its SF is uniformly distributed, the resetting learning rate scheme will be referred to as RUMSLR (e.g. as in Fig. REF ).
