perature \(T\)(Ficler and Goldberg, 2017) and the nucleus probability \(p\)(Radford et al., 2019), using the GPT-3.5-Turbo model over an average of 20 runs. As shown in Figure 4, scaling up ensemble size improves the LLM performance consistently across different tasks, despite the variation of these hyperparameters.