Figure 13: **Empirical Hutter LLM.** Bigram model with deterministic labeling function. Initial model trained on \(T_{0}=100,000\) samples. It generates \(T\) samples for Gen 1. Starting from Gen 2 models are trained on data generated by the most powerful model from the previous generation. \(\beta=3/2\). In this setting, there is mild model collapse coming from the finite sample bias.