We adopt Cosine Annealing Scheme [1]} and Adam optimizer [2]} in training. The number of iterations is 300K and the initial learning rate is \(10^{-4}\) . The batch size is 8 for human faces and 16 for other categories. We train our models using two Nvidia V100 GPUs.
