ASkewSGD performance is on par with full precision method, while the STE variants all suffer from strong oscillations (see [1]}, [2]}, [3]}). fig:losslogisticregression illustrates the effects of such oscillations on the convergence . In all settings, AdaSTE converges faster than BC, but still all STE variants exhibit a larger loss compared to other methods. Additional results are reported in sec:app:numerical-results.
