Scaling inverter.We train inverter models of varying size to see the effect of model scale on inversion performance. We note that the number of parameters in the inverter has a very large impact; with larger inverter models performing significantly better: under ablation settings, with the same number of training steps, the T5-large inverter achieves \(24\%\) higher BLEU score than T5-small. This finding indicates that we may more accurately invert language models simply by scaling our system.