While closed-form solutions have been developed for some specialized components <cite>(Martins et al., 2011)</cite> , this problem is in general more difficult than the one arising in the subgradient algorithm. However, the following result, proved in Martins et al. (2012) , allows to expand the scope of AD 3 to any problem which satisfies Assumption 1. Proposition 2.