where \(\textbf {x}_{in}\)  is the feature from the multi-head self-attention part, \(\emph {GELU}\)  is the activation function proposed by Dan [1]}, \(\emph {MLP}\)  is a fully connected neural network layer and \(Conv_{3 \times 3}\)  is a \(3 \times 3\)  convolutional layer.
