The early NAS methods [1]}, [2]} train all sub-networks from scratch to find the best one, but they required a lot of resources. To address this problem, many subsequent NAS methods [3]}, [4]}, [5]} use the weight-sharing strategy to allow all sub-networks to inherit each other's weights without needing to be trained from scratch, which greatly improves search efficiency. Therefore, we also adopt this method in our work.
