The second example aims to demonstrate the stability of CSG with backtracking (bCSG) with respect to the initially chosen step size \((\eta _n)_{n\in \mathbb {N}}\) . For this, we compare the performance of bCSG and the well-known AdaGrad [1]} method when carried out for a large spectrum of choices for \((\eta _n)_{n\in \mathbb {N}}\) .
