There are two major differences between our model and the LAS rescoring<cite> [10]</cite> . First, the deliberation model attends to both e and yr, while<cite> [10]</cite> only attends to the acoustic embedding, e. Second, our deliberation model encodes yr bidirectionally, while<cite> [10]</cite> only relies on unidirectional encoding e for decoding.