We begin by explaining the inner workings of the Transformer as proposed by Vaswani et al. in 2017 to solve the challenging problem of neural machine translation [1]}. We then proceed with a deep dive into the operations performed inside each component of Transformers and the intuition behind those operations. While several variations of the Transformer architecture have been developed, we restrict our discussion to the original architecture [2]}, [3]}, [4]}.
