Over time, methods in the NAS literature have evolved from prohibitively expensive but holistic and diverse search methods [1]}, [2]}, [3]} to lower cost approaches that search in more restrictive non-diverse search spaces [4]}, [5]}. This work, DONNA, aims at benefiting from the best of both worlds: rapid search in diverse spaces. We refer the interested reader to the existing dedicated survey of Elsken et al. [6]} for a broader discussion of the NAS literature.
