Evaluation of Random Search and Direct Transfer. Many NAS algorithms have attempted to use architectures as the central component for transfer [1]}, [2]}, which inspired us to look into the efficiency of direct transfer of top architectures found by RS. For both search spaces, we randomly search 50 architectures in each trial. The architecture with the highest validation accuracy will be selected as the final searched result of this particular trial.
In Table REF  we include the results for direct transfer (DT). For each task, we take the best architecture from the remaining 6 tasks, and average their performance on the selected task. The results are significantly worse than all the search algorithms. It shows that even if some NAS algorithm can be guaranteed to find the optimal architecture on a source task, its direct transfer performance on the target task can still suffer.
<TABLE>