**Transferability.** We next investigate whether inversions transfer to models of different size by evaluating our inversion models trained on the 7B version of LLama-2 on the 13B version and 70B version. Results are shown in Table 3. We observe that inversions transfer reasonably well, performing best on code generation, and significantly better between non-RLHFd models than between the chat models. We speculate that models may need to be further fine-tuned to adapt to different models.