_What are the limits of inversion?_ Our experiments show that much information about the input can be recovered from language model probabilities, but do not estimate the upper bound. The scaling analysis in Appendix G.1 implies that larger backbone models recover more information, but we do not run any experiments with backbone models larger than hundred-million parameter scale.