Many optimizers have been presented for training GANs (see, e.g., [1]}, [2]}, [3]}, [4]}, [5]}, [6]}). In this paper, we focus on a two time-scale update rule (TTUR) [3]} for finding a stationary local Nash equilibrium of the Nash equilibrium problem. TTUR uses sequences generated by each of the generator and the discriminator.
