Table 3 shows our knowledge analysis experiments' results. Llama-2-7b-chat performs similarly to Llama-2-7b on Hellaswag and MULU, while showing a slightly better performance on ARC and C-eval-tw. In the ARC and Hellaswag benchmarks, almost all continually pre-trained models outperform Llama-2-7b-chat. In the MULU benchmark, most continual pre-trained models tend to outperform Llama-2-7b-chat. However, in the case of the C-eval-tw benchmark, there is no clear pattern when comparing the efficacy of models utilizing simple methods for continual pre-training against Llama-2-7b-chat. It is worth noting that the observed differences mentioned above are subtle.