Large Language Models For Mathematical reasoning.It's well known that complex reasoning problems are challenging for NLP models, which include mathematical reasoning [25, 26, 27, 28, 29, 30], common-sense reasoning [58, 59], and logical reasoning [31]. A substantial body of current research is centered around the intricate task reasoning of the Mathematical Word Problems(MWP) [30, 60, 61, 62, 63, 64], which requires the ability to understand mathematical concepts, computation and multi-step reasoning [16, 17, 18, 19, 36, 40, 46]. Addtitionly, models are evaluated across different levels of MWP benchmarks on some mathematical reasoning datasets such as AddSub [65], MultiArith [66], SingleEQ [67], SVAMP [60], GSM8K [42], AQuA [29] and MATH [43].