* **Token reversal** (\(\text{REVERSE}_{token}\)): A given input \(x_{i}\), when tokenized, e.g. using BPE (Sennrich et al., 2015), consists of tokens \(x_{i}^{l}\), and the reversed version has the form \(\overleftarrow{x_{i}}^{l}=x_{i}^{|x_{i}|-l+1}\). * **Word reversal** (\(\text{REVERSE}_{word}\)): Each example is first split into words.2 We then reverse the string at the word level, joining it back together with spaces. Note that this input would then typically be tokenized for input into the LLM, e.g. using BPE.