where \(E_{test}^{clean}\) is the usual test error of the model trained on clean data (not AI-generated). This means that in Equations (2) and (4) for example, the \(k^{-c^{\prime}}\) is replaced by \(nk^{-c^{\prime}}\). One possible interpretation of this multiplicative degradation is that, over time (i.e as the number of generations becomes large), the effect of large language models (like ChatGPT) in the wild will be a pollution of the web to the extend that learning will be impossible. This will likely increase the value and cost of clean / non-AI-generated data.