Data efficiency of transformers on different vision tasks.
With limited inductive bias, the vision transformers are often data-hungry [1]}. Although the data-hungry issue of vision transformer for image classification has been studied [2]}, it has not been explored for other vision tasks. In this paper, we take the first step to delve into the data-hungry issue of detection transformers. As transformers become increasingly popular for vision tasks, like semantic segmentation [3]}, [4]}, 3D object detection [5]}, and video instance segmentation [6]}, we hope our work will inspire the community to explore the data efficiency of transformers for different tasks.
