Comparing the performance on IL of the two scenarios, Small and Small-P1\(\rightarrow\)Small-P2, results show that LMs are prone to more forgetting as they go through multiple CKL phases, despite having the same number of training steps. One of the reasons may be due to the learning rate scheduling, which is initialized at the start of each phase.