Figure 1: (Cartoon). Top-p (nucleus) sampling, temperature scaling of LLM generation, and finite sample bias lead to truncated or narrowed “tails” (left side), causing loss of scaling laws (top right) and loss of skills (bottom right). Here we visualize calculating the greatest common divisor (GCD) with answer 2 and 3 as two skills.