Thought CoT is an emerging ability primarily observed in LLMs, with limited advancements in small models. However, enhancing small models' CoT ability is conceivable through techniques like distillation. Magister et al. (2023) demonstrates that fine-tuning T5 with reasoning chains generated by larger teacher models and utilizing an external calculator for answer resolution can substantially enhance task performance across diverse datasets. Ho et al. (2023) generates and filters multiple reasoning paths to enrich the diversity.