In our evaluations, we compare against a number of external decoder-only transformer language models and unless otherwise stated we use the numbers published in the reports of the corresponding models. For English and code tasks, we share detailed results for Nemotron-4 15B, LlaMA-2 13B and 34B (Touvron et al., 2023b), Mistral 7B (Jiang et al., 2023), Baichuan-2 13B (Yang et al., 2023), QWEN 14B (Bai et al., 2023), and Gemma 7B (Gemma Team, 2024). For multilingual benchmarks, we report results against PaLM 62B and 62B-cont (Chowdhery et al., 2022) as well as models specially trained for multilingual capabilities such as mGPT 13B (Shliazhko et al., 2022) and XGLM 7.5B (Lin et al., 2022).