Footnote 2: Concurrently, DeepSeek-MATH-7B (Shao et al., 2024) also surpasses 80% accuracy. However, their approach relies on a much stronger base model extensively pre-trained on math-related corpora and a sophisticated RL algorithm. Our results are complementary to theirs.