LLM reasoning and manually annotated reasoning chains impose expensive overheads. Aggarwal et al. (2023) improves self-consistency by dynamically adjusting the number of samples, which can significantly reduce inference costs with marginal performance degradation. Ning et al. (2023) decomposed the questions in parallel and handled them simultaneously, reducing the reasoning time overhead. But it cannot handle complex questions. Zhang et al. (2023) accelerates the reasoning by selectively skipping some intermediate layers and then verifies the draft in another forward pass. Diao et al. (2023) borrows ideas from active learning to annotate examples with high uncertainty, reducing the human annotating cost.