We use these models to generate "dirty" training data \(\mathcal{D}(B)\): uniformly sampled pairs of integers \((a,b)\) and their (sometimes incorrect) pseudo-GCD, as generated by a trained transformer using base \(B\). Note: this dataset can be as large as we want. We also create a correct training dataset \(\mathcal{C}(B)\), by sampling pairs \((a,b)\) and their correct GCD.