[1]} uses a hierarchical transformer for reducing the computational cost. Instead of using positional embeddings, EsViT uses the Relative Position Bias to avoid the positional information being affected by the different cropping resolutions. Furthermore, EsViT uses the same updating method adopted by DINO and MoBY. On top of that, EsViT adds extra regional-level tasks to attach the inter-region relationships.
