We compare SGD, SGD with truncated models (aProx) [1]}, SGD with Importance Weight Aware updates (IWA) [2]}, Coin-betting algorithm (Coin) [3]}, Coin-betting with ODE updates (CODE) [4]}, COntinuous COin Betting (COCOB) [5]}.
