In this study, our analysis extends to the intermediate checkpoints of a series of state-of-the-art large language models, each featuring unique architectural designs and training paradigms, showcasing the latest advancements in natural language processing and machine learning. Among these models, Amber-7B and OpenLLMA-7B were replicated by us. The introduction to each model under scrutiny can be found in Appendix A.1.