Here we explore the possibility of alleviating model collapse via the acquisition of even a tiny amount of data from the true data distribution, to complement AI polluted data. We study two phenomena: (1) In the case of mixing \(\pi\)-fraction of the original data with a \((1-\pi)\) fraction of AI-generated data we exhibit a startling "grokking" phenomenon where test loss plateaus with increasing training data to finally decrease again according to the scaling law of the original model, and (2) in the scenario where we would like to compensate for missing "tail", we acquire some data from the tail of the original distribution to show that this needs to be done with caution: getting data from "too deep" in the tail is worthless while data closer to the precise "missing" tail can be beneficial. All proofs can be found in Appendix C.