The convergence rates above are confirmed by our experiments in Section . Note also that Theorem REF  is not in contradiction with [1]} stating that gradient descent might get stuck at the critical point \(\left(\delta ^{(L)}, A^{(L)}\right) = (0,0)\)  that is usually not a global minimizer. Indeed, we force \(\delta ^{(L)}\)  to have a non-trivial scaling by Assumption REF  (iii), so that \((0,0)\)  is simply not a point in the parameter space.
