Our proposed approach is to learn a conditional language model that maps from next-token probabilities back to tokens: \(p(x_{1:T}\mid\mathbf{v})\). We parameterize this distribution using a pretrained Transformer language model and train on samples from the unconditional model. Following work from Dumoulin et al. (2018) on feature-level conditioning, we use the cross-attention in an encoder-decoder Transformer to condition on the next-token vector.