To address these limitations, Vaswani et al. have proposed the Transformer, a machine translation model that introduces a new deep learning architecture solely based on "attention" mechanisms <cite>[2]</cite> .