It is noteworthy that the relative performance gain is more substantial with increasing task difficulty. Specifically, we observe that within the same task, the smaller model, Llama2-13B, gains ranging from \(28\%\)-\(200\%\), but only \(8\%\)-\(16\%\) over GPT-3.5-Turbo. Moreover, the more challenging task MATH yields gains of \(34\%\)-\(200\%\), in contrast to only \(16\%\)-\(69\%\) on the easier task GSM8K.