Tolerance with HyperparametersIn our experiments, we find that given sufficient training data, hyperparameters such as batch size, learning rate, and learning rate scheduler influence the rate of convergence, yet do not impact the final converged loss as long as their values fall within a reasonable range. This finding aligns with previous research [15, 16, 17]. Therefore, in order to obtain these \(k\) data pointsof \((N_{0},L_{0}),\ldots,(N_{k-1},L_{k-1})\), there is no need to perform extensive hyperparameter tuning. Instead, it is enough to use a fixed set of hyperparameters for all the \(k\) models, provided that the model is trained with no repeated data until convergence.