Traditional continual learning (CL) methods focus on addressing two aspects of transfer between sequentially incoming tasks: _forward transfer_ and _backward transfer_(Lopez-Paz and Ranzato, 2017). _Forward transfer_ refers to how past tasks affect the performance of the current and future tasks. _Backward transfer_ refers to how current or future tasks affect the performance of previous tasks. The general pretrain-finetune approach can be seen as an instance of _positive forward transfer_ where a model performs better on a target task after being pretrained on a more general source task. Moreover, catastrophic forgetting can be seen as an instance of _negative backward transfer_ where previous tasks suffer performance due to continued training on different tasks. With respect to these two aspects, CL approaches can be categorized into three main approaches: regularization, rehearsal, and parameter-expansion methods.