We categorize tokens into four categories: H\(\rightarrow\)H, L\(\rightarrow\)H, H\(\rightarrow\)L, L\(\rightarrow\)L. During the training process, we collected the loss of each token after training on each 1 billion tokens training data. We then used linear fitting and took the difference in loss between the first and last points as evidence of whether the loss decreased during the training process.