We show through comprehensive experiments that SLM significantly enhances token efficiency during pretraining and improves performance on downstream tasks. Furthermore, our findings indicate that SLM effectively identifies tokens relevant to the target distribution, resulting in improved perplexity scores on benchmarks for models trained with the selected tokens.