Footnote 2: The training step law (Kaplan et al., 2020) refers to the function between the intermediate training step and its corresponding _loss in one single training run_. For clarity, we highlight its difference from the data scaling law that predicts the early exit loss (Kaplan et al., 2020) or the loss obtained with optimal hyperparameters for each data budget (Hoffmann et al., 2022).