In Kaplan et al. (2020), OpenAI studies the relationship between the loss function and the number of tokens. In their experiments, they assume that consuming more steps is equivalent to consuming more time. Under this assumption, OpenAI defines a critical batch size that achieves a certain loss without consuming too many steps or tokens. This rationale is valid if the experiments are provided with unlimited GPUs (at least with in the scope of the experiments). Since GPUs are unlimited, enlarging batch size will not increase the single step duration but will decrease the total number of steps. However, in our experiment, since we have fixed resource (number of GPUs), we observe that doubling the batch size almost equals doubling the single-step time. Therefore, enlarging batch size to decrease total training steps has minimal effect on the total training time. In light of this observation, we drop the goal of "not consuming too many steps" and turn towards minimizing the token quantity to achieve the lowest loss, instead.