Footnote 6: [https://github.com/karpathy/nanoGPT](https://github.com/karpathy/nanoGPT)Mitigation:To our knowledge, rigorous theory (or even empirical demonstrations) on mitigation strategies against model collapse are yet to come, with one notable exception in (Bertrand et al., 2023) (see below). Several works discuss the need for _detection_ of AI-generated images or text (to avoid retraining on them), for example motivating research into watermarking strategies. (Bertrand et al., 2023) analyze iterative retraining on a mixture of synthesized and original data under several technical assumptions and find that there are fixed points governing the stability of iterative retraining.