Since fixed position encoding will reduce the accuracy as described in [1]}, we use \(3 \times 3\)  convolution to capture position information for the Transformer encoder. The core formula of position encoding is as follow:
\( \textbf {x}_{out}=MLP(GELU (Conv_{3 \times 3}(MLP(\textbf {x}_{in}))))+\textbf {x}_{in},\) 
