Our second observation is that a significant number of token losses exhibit persistent fluctuations, and resist convergence. The loss of many L\(\rightarrow\)L and H\(\rightarrow\)H tokens, as depicted in Figure 3 (b) and (c), show high variance during training. In SSB.2, we visualize and analyze the content of these tokens and find that many of them are noisy, which is consistent with our hypothesis.