Figure 25: **Autoregressive Bigram Model with Perplexity Loss.** Each sequence data have length 100. Initial model trained on \(T_{0}=10,000\) samples. It generates \(T\) samples for Gen 1. Starting from Gen 2 models are trained on data generated by the most powerful model from the previous generation. Top-p 1, temperature 1, \(\beta=3/2\).