3 SANet: Self-Attention Network Inspired by the Transformer architecture<cite> (Vaswani et al., 2017)</cite> which performed machine translation without recurrent or convolutional layers, we propose the Self-Attention Network (SANet) architecture targeting instead text classification.