Forgetting Data from Pre-trained GANs
Large pre-trained generative models are known to occasionally provide samples
that may be undesirable for various reasons. The standard way to mitigate this
is to re-train the models differently. In this work, we take a different, more
compute-friendly approach and investigate how to post-edit a model after
training so that it forgets certain kinds of samples. We provide three
different algorithms for GANs that differ on how the samples to be forgotten
are described. Extensive evaluations on real-world image datasets show that our
algorithms are capable of forgetting data while retaining high generation
quality at a fraction of the cost of full re-training.