Others work analyze theoretically, exploring the underlying principles and internal mechanisms. Li et al. (2023) reconstructs chain-of-thought reasoning as a multi-step combinatorial function. Theydemonstrate that chain-of-thought reduces the complexity of in-context learning to tackle complex questions. Feng et al. (2023) theoretically proves that a fixed-size Transformer is sufficient for computational tasks and dynamic planning with chain-of-thought. Merrill and Sabharwal (2023) observes that chain-of-thought can boost reasoning ability, with the extent of improvement increasing as the number of intermediate reasoning steps grows. Wu et al. (2023) leverages gradient-based feature attribution methods to explore the impact of chain-of-thought on outputs. The results indicate that chain-of-thought exhibits robustness to perturbations and variations in the question. In addition, there are some claims suggesting that the chain-of-thought ability stems from code data during the pre-training phase (Madaan et al., 2022; Zhang et al., 2023c), but there is currently no systematic work to substantiate this opinion.