\(\bullet\)_KM scaling law5_. In 2020, Kaplan et al. [30] (the OpenAI team) firstly proposed to model the power-law relationship of model performance with respective to three major factors, namely model size (\(N\)), dataset size (\(D\)), and the amount of training compute (\(C\)), for neural language models.