Given an input image, we first divide it into non-overlapping patches to be fed into the visual transformer. A fixed sinusoidal positional encoding is added to each embedded patch, and a few of the embedded patches are sampled randomly [1]} according to the masking ratio.
