NAO [1]} is an optimization algorithm that searches the best architectures based on the following principle. First, NAO is a Cell-Based Search Space algorithm like most modern NAS. Hence we just need to learn the adjacency matrix that represents the cells. Secondly, NAO is a two-step algorithm that first searches the best architecture in step 1. Then, in step 2 with this architecture, NAO optimizes the DNN's weights to searches for the best model. Thirdly,
NAO does not directly optimize the cell parameters, and it performs its optimization on a latent space of cell parameters.
