For the evaluation of the question-answering performance on the GSM8K dataset, we compute the accuracy based on the final answer provided by the problem solver. For the question generation part, we report automatic evaluation using SacreBLEU [1]} which is based on exact word overlap, BERT F1 score [2]} which is based on DeBERTa [3]} as the similarity model. We also report #Q, the number of questions generated compared to the number of reasoning steps needed to solve a problem.
