We also evaluate the performance of our 10Billion parameters SEER model in the low-shot setting, i.e. with a fraction of data (1% and 10% ImageNet) on the downstream task similar to previous studies [1]}, [2]}. The results are in Table REF . We observe the performance consistently improves on these both tasks as the model size increases. Especially on the 1% fraction, the improvement is the the most +2 pts.
