After SFT, to further improve the model, RL is applied to align the model to the specific goal. The model automatically samples responses, and a reward model scores these generated responses to distinguish their quality. For mathematical reasoning, it has been verified that rewards based on intermediate processes yield better results compared to rewards based solely on final results (Wang et al., 2023; Lightman et al., 2023).