Previous numerical evaluations [1]} indicated that increasing the batch size used in TTUR tends to decrease the Fréchet inception distance (FID) [2]}, which is a performance measure of optimizers for training GANs. This implies that using large batch sizes is desirable for training GANs. We are interested in examining the theoretical relationship between the performance of TTUR using constant learning rates and the batch size.
