will be very similar to the ground truth. If the sampling is sufficient and the reward model is strong enough to find high-quality reasoning paths that may have better generality and conciseness, RL can achieve better results. This can be the reason why RFT which using much more samples performs similarly to ours, as RFT only samples for multiple paths at once and only uses outcome supervision.