* the cross entropy loss in nats averaged over the tokens in a context
* the number of model parameters, _excluding all vocabulary and positional embeddings_
* the batch size
* the critical batch size defined in [14]. Training at the critical batch size provides a roughly optimal compromise between time and compute efficiency
* amount of processed tokens
* an estimate of the minimum amount of processed tokens needed to reach a given value of the loss. This is also the number of training steps that would be used if the model were trained at a batch size much smaller than the critical batch size
* number of training steps
* an estimate of the minimal number of training steps needed to reach a given value of the loss.