Scaling laws have been identified as critical empirical relationships for LLMs that delineate the impact of changes in model size, dataset size, and computational budget on model performance. Kaplan et al. (2020) focused on the distribution of computational resources for the training of LLMs. However, this principle is particularly significant as it underscores the relative importance of different factors to model performance, such as model architecture and batch size are secondary to the overarching influence of model size and dataset scope in reducing final validation loss.