In Table 4 , we compare deliberation models with an RNN-T [6] and LAS rescoring model<cite> [10]</cite> To understand where the improvement comes from, in Fig. 2 we show an example of deliberation attention distribution on the RNN-T hypotheses (x-axis) at every step of the second-pass decoding (yaxis).