**Mix-Review**(He et al., 2021) We use the English Wikipedia 13 to represent the original pretraining corpus. The mix-decay and mix-ratio are set to 4 and 0.7, respectively, which is the best hyperparameter setting in the paper.