As shown in Figure 1, we plot the batch size in x-axis, and token consumption in y-axis, the color of the points represents loss. Thus a horizontal line formed by the color points denotes a training curve. we use parabolas to fit the equal-loss points and connect the minima of the parabolas with red lines. The lines demonstrate the optimal batch size shifts large as the loss decreases. We then connect the three lines (see Figure 2) and find that the lines connect each other well into a linear relationship in the log space, from which we obtain the following relationship between batch size _bs_ and C4 Loss _L:_\(bs=\frac{1.21\times 10^{9}}{L^{6.24}}\).