The concept of emergent abilities in large language models (LLMs) draws researchers attention, as model sizes continue to scale. The phenomenon of "double descent," where a model's validation loss first worsens and then improves with increasing model complexity, was first proposed by Nakkiran et al. (2019). Furthermore, the "grokking" phenomenon, where models continue to improve even without a reduction in training loss, has been detailed by Power et al. (2022) and Murty et al. (2023), providing insight into the non-linear learning trajectories of LLMs.