Search Space: DenseNets are more efficient in terms of model size and computation workload than ResNets while achieving the same test accuracy [1]}. Moreover, DenseNets have many more skip connections; this provides us with more flexibility for exploration compared to networks with Addition-type skip connections (ResNets, Wide-ResNets, and MobileNets). Hence, in our experiments, we explore the CNNs with DenseNet-type skip connections.
