A recent approach, Elastic Weight Consolidation (EWC) [1]}, aims to overcome catastrophic forgetting and can be used to regularize few-shot GANs training [2]}. In our setting, we find that a simple L1-based weight regularization loss (Eqn. REF ) performs on par with EWC. We report results of L1-based weight regularization for simplicity.
