**Sampling.** Let \(x\) represent the task query and \(\mathcal{M}\) denote an LLM. In this phase, we generate \(N\) samples by solely querying the LLM \(\mathcal{M}\)\(N\) times with each sample represented as \(s=\mathcal{M}(x)\) or by integrating with other methods \(f_{\mathcal{M}}\) with \(N\) times executions where each sample is denoted as \(s=f_{\mathcal{M}}(x)\). We obtain a set of samples \(S=\{s_{1},s_{2},...,s_{N}\}\) at the end of this phase.