Inspired by _Evol-Instruct_ and Process-supervised Reinforcement Learning, this work aims to enhance the mathematical reasoning abilities of the SOTA open-source LLM, Llama-2 [20]. As shown in the Figure 1, we propose a new method named _Reinforcement Learning from Evol-Instruct Feedback_ (_**RLEIF**_), which could firstly generate diverse math instructions data by math-specific _Evol-Instruct_, then we train an instruction reward model (IRM) and a process-supervised reward model (PRM) [36, 37, 38, 39, 40, 41], the former indicates the quality of the evolved instruction and the later receives feedback for each step in the solution. The brand-new _Evol-Instruct_ method includes two downward evolution and upward evolution progress to produce the grade school math and challenging math respectively. Initially, we re-generate, filter and finetune the original math instruction data from GSM8k [42] and MATH [43]. Immediately, we train the Llama-2 models to obtain the reward models and our _WizardMath_.