It is crucial to know whether our observations in visualizations are general across different backbone architectures. Thanks to the general applicability of SimMIM [1]}, we further perform the visualizations on SwinV2-B [2]} (in Section ) and RepLKNet [3]} (in Section ). Fortunately, we find that most of the observations could be transferred across architectures, ViT-B, SwinV2-B, and RepLKNet.
