Moreover, We relate the selected tokens' loss to its downstream task performance via a power law in Figure 7, which is similar to a concurrent study (Gadre et al., 2024). Observing the curve fitted from the data points in the graph, the average loss of tokens selected by the SLM shows a positive correlation with the performance of downstream tasks, whereas the average loss of tokens not selected exhibits a negative correlation with downstream task performance. Therefore, it is not necessary for the all tokens' loss to decrease to benefit the model's ultimate performance. See Appendix D for more details.