_In summary, continually pre-training LLMs, both re-warming and re-decaying are necessary to maximize adaptation to the new dataset; small increases or decreases in \(\eta_{\text{max}}\) allow to trade-off between more or less adaptation; a stronger distribution shift between \(\mathcal{D}_{0}\) and \(\mathcal{D}_{1}\) exacerbates forgetting and enhances adaptation; and the duration of linear warm-up phase does not appear to be impactful on forgetting or adaptation._