(Alemohammad et al., 2023) conduct an empirical and analytical analysis on generative image models of what they term the "self-consuming" or "autophaguous" loop. They conclude that without enough fresh real data at each generation, future models necessarily will have their precision or recall decrease. They model the influence of each new AI-generation via a generic _sampling bias_\(0\leq\lambda\leq 1\). In the case of image generation this refers to feature parameters at generation that favor quality over diversity (suitably quantified). More precisely, \(\lambda=1\) corresponds to unbiased sampling and \(\lambda=0\) corresponds to sampling from the modes of the generative distribution. \(\lambda\) models biased sampling methods commonly used in generative modeling practice, such as truncation in BigGAN and StyleGAN or guidance in diffusion models. In the case of Gaussian distributions, \(\lambda\) is the shrinking factor of the variance of the next generation. Their empirical work studies GANs and denoising diffusion probabilistic models for image generation on FFHQ and MNIST and single Gaussians for both theoretical and empirical observations. As in (Shumailov et al., 2023) they observe (and prove for the case of a single Gaussian) that estimation error alone leads to vanishing variance with number of iterations. (Alemohammad et al., 2023) also empirically observe an initial boost in performance in a regime where modest amounts of synthetic data are mixed with the original data before larger amounts of synthetic data lead to ultimate degradation. This might mimick larger-scale results that demonstrate how synthetic data mixed with true data improves performance in some scenarios (see _Benefits of synthesized data_ below). Indeed, in its simplest form, data augmentation (rotations, cropping etc. ), a widespread highly beneficial practice in ML training, can be viewed as the simplest form of data generation.