We briefly review the pretraining process of large language models and summarize key findings from neural scaling laws, then we formalize the problem we study. For more related work, please refer to Sec. 6.