As expected, the iterates produced by the SG method do not converge to the optimal solution, but instead remain in a neighborhood of \(u^\ast \) . The radius of said neighborhood depends on the choice of \(\tau \)  and decreases for smaller \(\tau \) , see [1]}.
