Mini-batches can be comprised of a mix of samples from different language pairs<cite> (Johnson et al., 2017)</cite> or the training schedule can cycle through mini-batches consisting of a language pair only (Firat et al., 2016a) .