We compare Nemotron-4 15B to existing multilingual language models: XGLM (Lin et al., 2022), mGPT (Shliazhko et al., 2022), and BLOOM (Scao et al., 2023). XGLM and mGPT are models specially trained to have improved multilingual ability by up-sampling the presence of non-English languages in the training data. In contrast, BLOOM, like Nemotron-4, is a general purpose language model that was trained on a combination of English, multilingual, and code data. In Table 7, we clearly see that Nemotron-4 achieves the best performance amongst all models - realizing almost a 12% improvement in the four-shot setting.