_In summary, for weak and stronger distribution shifts alike, it is possible to achieve competitive performance to a model trained on \(\mathcal{D}_{0}\cup\mathcal{D}_{1}\) by utilizing a simple and scalable combination of LR re-warming, LR re-decaying, and replay.