7 Learning rates of 0.5 for SGD and 0.0002 for Adam or very similar are shown to work well in NMT implementations including GNMT<cite> (Wu et al., 2016)</cite> , Nematus, Marian, and OpenNMT (http://opennmt.net).