Code for reproducing all experiments is available at anonymous.4open.science/status/language-model-inversion. Our dataset of prompts will be provided upon paper publication. All experiments are fully reproducible and documented in the Github repository, including all model-training, logit sampling, and evaluation.