We also find that reversed models can not only generate text continuations in the normal left-to-right direction, but can generate the beginning of the text given a continuation -- a capability that standard models lack. We give an example in Table 8. This reverse generation function can be useful in itself, for example for instruction backtranslation (Li et al., 2023).