
The parameter \(\epsilon \)  is determined using line search and ensures the optimizer makes sufficient progress towards the minimum at each iteration, i.e. ensuring the update step satisfies Armijo's condition or the Wolfe conditions [1]}. Further discussion is given in subsec/convergence.
