Formally, given input \(x\), we train \(\mathcal{M}\) to sequentially generate textual outputs \(y\) consisting of multiple segments \(y=[y_{1},\ldots,y_{T}]\), where \(y_{t}\) indicates a sequence of tokens for the \(t\)-th segment.3 Generated tokens in \(y_{t}\) include text from the original vocabulary as well as the reflection tokens (Table 1).