In this paper, we study the more standard <cite>transformer</cite> for speech recognition within the hybrid framework, and provide further insight to this model through experiments on the Librispeech public dataset.