ViT [1]} replaces all the CNN structures with several transformer layers and reaches state of the art performance on image recognition and are known as the pioneer of vision transformers. ViT contains three segments: 1) patch and positional embedding, 2) Transformer encoder, and 3) multi-layer perceptron (MLP) head.
