Where \(x^{*}\) is the predicted inversion, \(d\) is the embedding dimension, and \(\mathbf{v}\) is padded with zeros at the final position. In practice we use \(|\mathcal{V}|=32000\) and \(d=768\) for all experiments which leads to a fixed-length input sequence of \(42\) words.