Inverting from outputs?Besides inverting from the probability vector, natural procedure to consider is predicting the prompt directly from the output of the language model. For example, given the model output "Bogota", we may predict the input "What is the capital of Columbia?". We hypothesize that a single logit vector contains much more detailed information about the prompt then a single sequence sampled from the argmax of these vectors. However, we consider this scenario in our _Sample inverter_ baseline described in Section 6.