For a given training run with a fixed cosine cycle length set to match the target number of training steps, then by Hoffmann et al's own results, the early intermediate losses will overestimate the final loss of an optimally trained model with the same number of training steps. This implies that early intermediate loss values should not be used to fit a scaling law in final loss values.