Fine-tuned LLM for MathAnother sort of works Lightman et al. (2023); Luo et al. (2023); Azerbayev et al. (2023); Yue et al. (2023); Yu et al. (2023); An et al. (2023); Li et al. (2023); Gou et al. (2023) try to improve performance directly by training the model on mathematical data. A direct way is to use fine-tuning to improve models. One widely used method is to use synthetic data, which is very close to our approach: MetaMath Yu et al. (2023) presents to bootstrap questions to augment data. LeMA An et al. (2023) collects mistake-correction data pairs by using GPT-4 as a corrector. And MuggleMath Li et al. (2023) augments the GSM8K dataset by incorporating GPT-4 with a series of pre-defined operations. Compared to these synthetic data based efforts, our data synthetic method is much simpler and more scalable due to introduce less prior and constraint.