Moreover, apart from the aforementioned findings, it should be mentioned that we plan to publicly release the intermediate checkpoints of Amber-7B and OpenLLaMA-7B, which not only enhances the comprehension of scaling laws but also helps to develop more effective training strategies for LLMs. In conclusion, we hope our findings and open-sourced checkpoints can guide the developers to understand the optimization process of LLMs and facilitate the growth of foundation models.