As demonstrated in Figure 1, Nemotron-4 15B exhibits high downstream accuracies across a wide range of English, code, and multilingual evaluation areas. In comparison to leading similarly-sized, open models we show that Nemotron-4 15B is significantly better than LLaMA-2 34B (Touvron et al., 2023b), which has over twice the number of parameters, and is better than Mistral 7B (Jiang et al., 2023) on all English evaluation areas. Additionally, Nemotron-4 15B achieves competitive accuracies to QWEN 14B (Bai et al., 2023) and Gemma 7B (Gemma Team, 2024). In a comparison across a wide range of programming languages, we find that Nemotron-4 15B achieves better average accuracy, and in particular on low-resource programming languages, than Starcoder (Li et al., 2023), a code-specific model, and Mistral 7B. As Nemotron-4 15B was trained on significant amount of multilingual data, it is currently the state-of-the-art general purpose model in its size class on all multilingual benchmarks. We find that Nemotron-4 is better than PALM 62B-Cont (Slav Petrov and et al., 2023), and also outperforms multilingual-specific models such as XGLM (Lin et al., 2022) and mGPT (Shliazhko et al., 2022).