_(4) Mitigation Strategies._ In Theorem 3.2 we show that mixing AI-generated data with even a small amount of clean data mitigates model collapse by introducing a grokking phenomenon. The length of the plateau is of order \(k^{\beta}/\pi\), where \(\pi\) is the proportion of training data which is from the true distribution (i.e clean data). When \(\pi=0\) (i.e only AI-generated data available), this plateau goes on forever (as in (2) and (4)). When \(\pi>0\), however small, the plateau finally halts, and the error continues to decrease a la \(T^{-c}\). This grokking phenomenon holds in the setting of _deterministic_ ground truth labels (like in the models of Hutter (2021); Cabannes et al. (2023)). For transformer models, such deterministic settings are found for instance in arithmetic tasks, and we demonstrate it empirically in our GCD transformer experiments. The grokking effect becomes attenuated in probabilistic settings, where it can lead to an S-shaped learning curve (see Figure 19). We also identify regimes where adding AI data can be beneficial and discuss ways to curate "tail" data to mitigate AI-data effects.