This is related to a more general neural network problem known as the stability-plasticity dilemma [1]}, where plasticity and stability refer to integrating new knowledge and retaining previous knowledge respectively. Such dilemma is at the heart of the research area of Continual Learning (CL) also known as lifelong learning [2]}.
