In heterogeneous combination experiment, GPT-3.5-Turbo is used for generating the intermediate answer with \(K=8\), and GPT-4 is then employed to solve for the final answer with \(K=32\). In Figure 7 (right), compared with the result of GPT-4 with \(K=32\), the hierarchical method improves performance from \(35\%\) to \(47\%\), suggesting the deployment of different LLMs at the corresponding level of problem-solving can improve the performance in a cost-effective manner.