The computation of PE using sinusoidal functions does not include any learnable parameters and can be performed during or before training a neural network. Recently, various other methods for PE have been proposed, including methods that have learnable parameters [1]}, [2]}. However, no considerable difference between various PE methods is reported in the literature [3]}.
