TTUR based on adaptive methods can be defined by replacing SGD with adaptive methods for training deep neural networks. For example, TTUR based on adaptive moment estimation (Adam) [1]} with decaying learning rates \(\alpha _n^G\)  and \(\alpha _n^D\)  converges almost surely to a stationary local Nash equilibrium [2]}.
