As for dropout training, it was pointed out in <cite>[8]</cite> that <cite>transformer model</cite> for sequence to-sequence ASR may suffer from overfitting easily, and regularization such as dropout is important to address such kind of issue.