Figure 10: Empirical Validation of Theorem 3.2. The broken line corresponds to the \(T^{-(1-1/\beta)}\) scaling law that would hold throughout in the absence of pollution. Notice the grokking behavior predicted by the theorem. For this experiment, the Zipf exponent of the true data distribution \(p\) is \(\beta=2\).