Figure 1: Left: Actual and predicted loss trajectories of a 2B model on the C4 test data (Section 4.1). Right: Actual and predicted loss trajectories of a 33B model on the code test data (Section 4.2). The actual and predicted loss trajectories closely align, especially after the initial warm-up stage.