AssumptionTo simplify the discussions, we stick to the following assumptions to derive the precise scaling laws, each of which mirrors real-world scenarios in pre-training modern large language models: