In this section, we elaborate on the details of our _WizardMath_. Following WizardLM and PRMs[36], we propose _Reinforcement Learning from Evol-Instruct Feedback_ (_**RLEIF**_)_, which integrates the _Evol-Instruct_ and reinforced process supervision method to evolve GSM8k and MATH, and fine-tune the pre-trained Llama-2 with the evolved data and reward models.