Apart from using Fibonacci line search and \(k\) -subsecting, one could use other optimization methods, such as, bisection, Newton’s method, or gradient decent [1]}. However, these methods require derivatives, which cannot be computed for the analyzed, discrete, function of classifier evaluations.
