Group III: Checkpoints of heterogeneous architectures. Kornblith et al. [1]} show that better network architectures can learn better features that can be transferred across vision-based tasks.
Therefore, we construct the third group of checkpoints by using different neural architectures. Four of them belong to the Inception family [2]}, one is Inception-ResNet-v2 [3]}, six come from the MobileNet family [4]}, and two are from ResNet-v1 family [5]}. We train them on ImageNet till convergence. Figure 3 and Table 6 in Appendix visualize their fine-tuning accuracies on the four downstream tasks.
