We now consider the problem of inverting the process: given the probability vector, we attempt to produce the prompt that led to these next-token probabilities. Given some unseen model \(f:\mathcal{V}^{T}\rightarrow\Delta^{|\mathcal{V}|-1}\) which gives next-token probabilities, we would like to learn to invert this function from samples: pairs of text prefixes and their associated next-token probability vectors \((x_{1:T}^{1},\mathbf{v}^{1})\ldots(x_{1:T}^{J},\mathbf{v}^{J})\).