To start the analysis, we select two datasets with increasing difficulty, i.e., GSM8K and MATH, to calculate the relative performance gain. The relative performance gain \(\eta\) is given by: \(\eta=\frac{P_{\text{m}}-P_{\text{s}}}{P_{\text{s}}}\) where \(P_{\text{m}}\) and \(P_{\text{s}}\) are the performances (accuracy) with our method and a single LLM query, respectively. The results are shown in Table 5.