Numerous endeavors can be undertaken to reduce human costs using unannotated (or very few annotated) data by utilizing the self-consistency (Wang et al., 2023). Hsieh et al. (2023) employs prompts to generate answers from much fewer labeled/unlabeled data, followed by the generation of rationales that prompt the language model to provide reasoning for the given answer. SCoTD (Li et al., 2023) finds that sampling multiple reasoning chains per instance from teachers is paramount for improving the capability of students. SCOTT Wang et al. (2023) utilizes contrastive decoding Li et al. (2022); O'Brien and Lewis (2023) during rationale generation for teacher models. Furthermore, to tackle the shortcut problem, it employs a counterfactual reasoning objective while training student models. DialCoT Han et al. (2023) decomposes reasoning steps into a multi-round dialog and selects the correct path using the PPO algorithm. Jie et al. (2023); Wang et al. (2023) add special tokens for mathematic problems. This high-level information improves the consistency of reasoning steps.