After conducting theoretical analysis and deriving scaling laws, this section presents empirical experiments to validate the efficacy of scaling laws. Following standard practice, we utilized the decoder-only Transformer architecture [17] and conducted experiments on two datasets: one utilizing the C4 dataset and the other utilizing a customized mixed dataset. We followed the estimation steps outlined above to derive the scaling-law formulas.