* **Entity-preserving reversal** (\(\text{REVERSE}_{entity}\)): We run an entity detector over a given training sample3, which also splits the non-entities into words. We then reverse the words, but keep the word-order of entities in their original left-to-right order. The string is then joined as before with spaces. See Table 2 for an example. Footnote 3: We use the flair/ner-english-large model for entity detection (Schweter & Akbik, 2020). * **Random segment reversal** (\(\text{REVERSE}_{rand}\)): Instead of running a relatively costly segmentation such as an entity detector, we experiment with randomly segmenting the sequence into chunks of size between 1 and \(k\) tokens using uniform sampling. We then reverse the segments, but keep the word order within each segment in their original left-to-right order. The segments are then joined with a special token "[REV]", which indicates the end of left-to-right prediction for the given segment. During training epochs, each time the example is seen we perform a different random segmentation to increase diversity. See Table 2 (last row) for an example.