Attention: Multi-head self-attention has demonstrated its capacity in neural transduction models<cite> (Vaswani et al., 2017)</cite> , language model pre-training (Devlin et al., 2018; Radford et al., 2018) and speech synthesis (Yang et al., 2019c) .