Pretraining CorpusFor mathematical reasoning, we utilize the OpenWebMath (OWM) dataset (Paster et al., 2023), which comprises approximately 14B tokens sourced from math-related web pages in the Common Crawl.